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ABSTRACT 

Five invitational addresses presented at the Fourth 
NationalConf erence of the Research Council for Diagnostic and 
Prescriptive Mathematics are included in this document. "The Nature 
of the Clinical investigation" (Romberg and Uprichard)^ discusses the 
validity of clinical investigations and suggests guidelines for 
conducting such studies of instructional techniques. "A Clinical 
Model for Diagnosing Mathematical Def iciencies, (MD) Squared, 
Incorporating Educational Cognitive Style" (Speer) describes a 
process that takes into account factors that contribute to an 

individual ! s unique learning style_afid content deficiencies. 

"Feedback in Diagnostic Testing" (Engelhaxdt) reviews the literature 
on feedback as it relates to testing. Difficulties in existing 

research are identified, and needed research and changes in 

diagnostic procedures are suggested. "Counting Performance and 
Achievement: Some Preliminary Observations" (eaiiahan| considers the 
rote and rational counting performance of young children , with 
variables and relationships discussed. Finally, "A Perspective on the 
Future" (Heddens) briefly poses questions concerning the direction of 
research efforts and provides suggestions for attaining the goals of 
the Research Council. Three reaction papers are also included. 
(MNS) 
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Preface 



In 1974, the First National Conference on Remedial Mathematics 
was held at Kent, Ohioj under the sponsorship of Kent State University 
and the Kent Educational Development Service Office. This conference, 
and two subsequent conferences in 1975 and 1975* provided. impetus for 
the formation of the Research Council for Diagnostic and Prescriptive - 
Mathematics—an organization created to promote stimulation, generation, 
coordination, and dissemih|ttibti of research and development efforts in 
diagnostic and prescriptive techniques. 

In 1977, the University of Maryland, in cooperation with the 
Maryland State Department of Education, hosted the Fourth National 
Conference on Diagnostic and Prescriptive Mathematics (a name change 
which reflects the aims of the RCDPM) . This conference was planned 
for the purposes of (1) disseminating knowledge and techniques for 
diagnosing and prescribing activities. for children and (2) providing 
a forum for critical discussion of research. Pursuant to these .purposes 
the conference included both general and research sessions encompassing 
talks, workshops, videotaped diagnostic sessions, sample analyses , and 
critical discussions on major problems in the field of diagnostic and 
prescriptive mathematics. 

The Invitational Research Jtessionsj the subject of this report, 
included two types of major thematic addresses, namely* JEX5 reports 
of completed or ongoing research and (2) analyses of problems and _ 
needed research. Each thematic address was followed by a prepared 
reaction wliich, in turn* was followed by a panel discussion by selected 
speakers at the conference. The five thematic addresses are outlined 
in the following paragraph. 

"The Nature of the Clinical Investigation" C^mberg & Uprichard) 
discusses the validity of clinical investigations and suggests guide- 
lines for conducting such investigations in the study of instructional 
techniques and effects. 

"£MD)^--A Clinical Madel for Diagnosing Mathematical Deficiencies 
Incorporating Educational Cognitive Style" (Speer) describes a diag- 
nostic and prescriptive process that takes into account a variety of 
factors that contribute to an individual's unique learning style and 
content deficiencies; 

"Feedback in Diagnostic Testing: Survey and Needed Research" 
(Engelhardt) reviews the literature on feedback as it relates, to 
testing by questioning the "standardizing" procedure- of prohibiting 
or delaying correct/incorrect feedback in individually administered 
diagnostic tests. Difficulties with existing research are identified 
and suggestions are made for heeded research and changes in diagnostic 
procedures. 
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"Counting Ability and Achievement in Arithmetic" (Callahan) con- 
siders the rote and rational counting performance of young children. — 
Variables associated with performance are discussed and relationships 
between counting performance and performance on various other arithmetic 
tasks are examined. 

A final paper_»_ entitled "A Perspective on the Future'% given by 
James 7eddens . RCDPM President, poses questions concerning the direction 
^f research efforts and provides suggestions for attaining the goals 
of the Research Council. 

The Research Council for diagnostic and Prescriptive Mathematics 
is indebted to ^s_Uni*rersity of M^yla^df the _Arithmetic_Center at 
the University of Maryland, and the Maryland State Department of Educa- 
tion for their support. A particular note of congratulations is due 
to Dr. J. Dan Knifong for his outstanding efforts in organizing and 
overseeing the operation of the conference. 



William R. Speer 
July, 1977 
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Research Session Speakers 

LEROY CALLAHAN, State University of New York at Buffalo, teaches 
courses on improvement of instruction in elementary mathematics . He 
has developed various protocols for diagnosing math learning difficulties * 
and directs Project etBSE, a clinic program in the Buffalo Public Schools. 

LELON CAPPS, University of Kandas,_acts_ as Senior Professor in Con- 
ducting Research on Error Patterns and Slow Learners in Mathematics. 
Dr. Capps is active in consulting with and creating diagnostic and 
prescriptive centers in public schools in Kansas. 

JON ENGELHARDT, Arizona State University, has developed a graduate 
program at Arizona in diagnosis and remediation of mat!-°maticai learning 
difficulties, and has established a Mathematics Learning Center. Dr. 
Engeihardt is the Treasurer of the Research Council for Diagnostic and 
Prescriptive Mathematics. 

JAMES HEDDENS , Kent State University 3 is_ author of Today's Mathe- 
matics . Dr. Heddens is responsible for the clinical program at Kent State 
^ahd is President of the Research Council for Diagnostic and Prescriptive 
Mathematics. 

0 _ 9 

LLOYD HUTCHINGS, Francis Marion College, in South Carolina, is 
best known for his development of low-stress algorithm for whole- 
number computation which have been featured in a recent National Council 
of Teachers of Mathematics yearbook. 

TOM ROMBERG ^ University of Wisconsin, is one of the nation's leading 
researchers _ih elementary school mathematics. He directed the much- 
acclaimed DMP program which is based on research done at the Wisconsin 
Center for Research and Development. 

WILLJAM SPEK, Bowling Green State University, is Director of the 
Mathematics Clinic and teaches elementary and secondary mathematics 
methods. Dr. Speer is currently serving as the Publications Chairperson 
for the Research Council for Diagnostic and Prescriptive Mathematics. 

EDWARD UPRICHARDj University af South Florida, is Director of 

Graduate Studies in the College of Education. He teaches courses on 

diagnostic and prescriptive instruction in mathematics. Dr. Uprichard 

has published several articles, and made presentations on the treatment 
of learning difficulties in mathematics. 
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The Nature of the Clinical Investigation 



^Thomas A* Romberg 
/University of Wisconsin-Madison 



./ 



A. Edward Uprichard 
University of South Florida 



For the experimentalist science progresses only in 
the laboratory; the theoretician views experiments 
rather as guides and tests for his code!? and 
theories ; others see the most^ important task making 
counts and measures, or arriving at predictions, or 
formulating explanations; the fieldworker and 
clinician have still other viewpoints. All of them 
are right;: what _is wrbhg_is_ only. what they-deny* 
hot what they affirm. (Kaplan, IS&tyJP? 30) * . 



We believe our audience to be investigators (primarily fieldworker s 
and clinicians) interested in diagnosis and remediation as they are ; 
related to the teaching of mathematics • _■ We also assume that not all 
such investigators are aware of t he appropriate methods of inquiry to \_ 
study such problems. It is our experience that most educators have been 
trained to believe that to research is to experiment. Designing studies 
based on Campbell and Stanley (1963) and testing hypotheses using ever 
increasingly complex statistics have for many become the cannons of • 
inquiry.. Unfortunately _this perspective of research is wedded to a 
particular philosophy of - science— Baconian empericism — no longer con- 
sidered the only method of inquiry in many philosophic circles. In 
particular , emperical inquiry in education has borrowed the tools and 
techniques from pther disciplines— such as agriculture—which cjjnnot 
capture the _dyn™i^^haract eristics if^nlng chiidren; At last 
year's conference two papers were presented which attacked the use of 
"standard 11 research o methods in the study of instruction (Wilson, 1976 & 
Romberg, 1976). * \ : ; ' 

In this paper it is our intent to go beyond those papers and 
examine the nature of one particular type of research as an alternative 
research methodology, the clinical investigation, and to offer some 
suggested guidelines for conducting clinical investigations focusing on 
diagnostic principles, and relating the, results to instructional events* 

In order to study the nature of the clinical investigation, it is 
necessary to briefly address the class of activities to which it belongs, 
namely, scientific inquiry. 

Throughout recorded history man lias attempted to obtain more 
knowledge about his environment and appraise its significance. In fact, 
within the very nature of man it is important .that he make his world and 

his life meaningful \hd significant. To this end he has strived cease- 

lessly, but across ine, centuries there have been changes in the way in which 
mail has obtained his information, organized it And analyzed it. 



To understand the place of clinical investigation! within the realm 
of scientific inquiry we believe' that it is important th|t investigators 
realize that there are several' sources of knowledge which man has used 
and still uses in obtaining knowledge.. The^fiirst and most prevalent is 
personal experience. For ^example* a classroom teacher may find a 
particular teaching method useful with a certain group of Btudents and 
may record that information for use in future years, fhere^are many 
dangers in appealing to personal experience, generalizations can be 
drawn oh insufficient evidence or too few examples^ pr incorrect con- 
clusions can follow from prejudice or evidence being left out because it 
was hot consonant with earlier experiences. Also there is always the 
danger of failing to recognize which were the salient, features of a 
situation and which were irrelevant i However » we still base touch infor- 
mation on personal experience. _ _ 

A second source of information has and continues to be authority ~. 
In everyday life a certain amount of ? aaowledge is i handedjiown by parents 
teachers* scientists, for example^ and must )>e taken on trust ; fcife is 
too short to test the validity of every^iew t hat is held. For example § 
it is commonplace within education to expect committees of scholars in a 
particular field to outline directions ; This is an important part of 
how human beings _gatiter informat ion i However^ just because it has been 
handed down and widely believed does not necessarily mean it is true. 
Generally speaking the expert is better informed in his field than other 
people because of his level of intelligence, training and experience, 
but experts disagree among themselves. 

A third method of arHoiflriv inquire has b^ deductiv e reasoning. 
In ancient Greece the deductive method of reasoning was developed to a 
highly refined art. Euclid's elements remain as one of the pinnacles of 
human thought. Deductive reasoning is used in everyday life to solve a 
host of problems. The detective, the doctor, and the educational 
researcher use it. The diagnostician in particular uses it when he 
searches among evidence and symptoms and selects items which appeared at 
first to be unrelated and brings them together in a way that logically 
lead to a conclusion. Note* however, that deductive reasoning^oniy 
enables us to deduce the consequences of what was already known; It 
does hot yield any really hew knowledge, tf one of the premises is 
untrue the conclusion will be false. Thus, it cannot be relied upon 
exclusively. 

The fourth method of inquiry is induction . In the seventeenth 
century Francis Bacon successfully attacked the Aristotelian method of 
sy logistic reasoning. His notion was that a scientist begins by car- 
rying but experiments whose aim is to makfe carefully controlled 
and meticulously measured observations at some point on the frontier 
between pur knowledge and ignorance. , He systemically observes and 
record^his findings and in the course of time he and other workers in 
the field accuinulate a lot of^shared and reliable data. As this grows 
general features begin to emerge and individuals start to formulate 
general hypotheses (statements of a law-like character) which fit all 
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the known facts and explain how they are causally related to each other. 
The Individual scientist then tries to confirm his ; hypothesis by finding ^ 
evidence which will support it. If he succeeds in verifying it he has * 
discovered another scientific law which will unlock more of the secrets 

of nature. Thus, the existing stock of scientific knowledge is added to 

in the frontier and our ignorance pushed back, the process begins again 
on a new frontier. 

From the 17th century to the beginning of the 20th century Baconian 
empericism based on the fundamental notions of inductive inquiry, were 
viewed as the method of scientific inquiry in most fields. In *this 
century more and more philosophers of science when examining major 
scientific breakthroughs have -fouiid that the inductive methpd is not the 
method used by most scientists in forming generalizations and concepts 
about the world, in fact as Einstein stated "There is no inductive 
method which could lead to the fundamental concept of physics." 0 Failure' 
to- understand this fact constituted the basic philosophic error of so * 
many investigators in the 19th century. Bew3$r in 1933 proposed another 
methpd which he pretentiously titled The Scientific Method . .His description 
combines both inductive and deductive reasoning in a sequential state of 
hypothesizing, logical consequences of hypothesis * more data, etc. 

Now in the later part of the 20th century it has been posited that 
scientific i?^^ 1 ?^ 08 ?.??? lead to internal truth but rather to sys- s. 

tematic doubt. Karl Popper (1963) and other^aisif icationists are 

arguing that the critical falsification is important and not critical 

confirmation. It is their notion that sciences are not bodies of 

established fact, rather they are practical statements about the level 

of knowledge in a particular area. This implies that theories are hot j 

bodies of, impersonal facts, but are products of the human mind. This 

makes theories' personal achievements of an astonishing order. The 

implications of this stance are as follows: 

a 

1) ?^_?5^??tists arrive at a theory does not bear on its 
scientific o^ logical status i _ ^ 

2) Second, observation and experiments far frbm g*Y*ng *ise to 
the theory are partially derived from it and they are 
designed to falsify the theory. 

3) At no point is induction a major part of the set of activities. 

Instead, hunch, inspiration, illumination, and insight, are as important 
as control. Explanation and prediction become critical aspects not 
verification. 

Activities within scientific inquiry may be thought df in two 
contexts — the context of discovery or the context of justification. 
Researchers focusing on activities within the context of justification 
are guided by a "logijc of proof, 11 They are primarily interested in / 
reasons for accepting or rejecting hypotheses (confirming or falsifying, 
propositions) . Researchers focusing bh activities within the context of 
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dlscovery are guided, by a "logic of discovery. 11 They are interested in 
s possible reasons for generating or entertaining propositions. The 
results of such inquiry rather than learning facts or laws to follow are 
I4eas to use, modify, and expand upon. 

The clinical. investigation belongs to a subclass of activities 

within the context of discovery.. It is an inquiry procese that is used 
to^ search for and examine patterns in the study of phenomenon(a) in 
order to generate an array of data and hypotheses rather than to vali- 
date conclusions. It is common for chance, intuition, and imagination 
to play important roles in searching for intended and/or unintended 
outcomes in this type of investigation. * 

Success with the clinical investigation depends on two aspects: 
Arialy tic /Synthetic Procedures and Methodological Techniques. Analytic/ 
Synthetic research focuses on the development of guiding models, or 
paradigms^ and explanatory theories {Wilson* 1976)V These models and 
theories play key roles in designing the clinical investigation, 'col- 
lecting and interpreting data* akd in formulating hypotheses. 

Because education is of such\iaiversal concern in our society and 
everyone has been in schools, ^st ^ve^one feeis^ free and competent to 
speak about it in general terms. .We\are now overwhelmed with a lit- 
erature of unsubstantiated general ideas and principles often based on 
firm prejudices and soggy^axguments/ Unfortunately* this literature is 
not new in education. Our history is an open record attesting to a lack 
of intellectual discipline.. This is also true in studying diagnostic 
principles and trying to relate the results to instructional practices 
But, we are not pessimistic about the state of affairs. Unsubstantiated 
claims are a natural part of inquiry. Our comaoon^probiem is how to 

• attack the belief structure where it is unsupported by- data and sys- 
tematic theory. The clinical study is well suited to this task for as 
Popper argues to falsify the proposition— all swans are white— we need 
to find only one "black" swan. No matter how many examples may be found 
to confirm the proposition only one counter example can falsify it. 
Thus, in the Popperian view* theory building begins with existing 
propositions derived from prior theories^ hunches, biases, etc Then 

" through systematic' attempts 'to falsify these claims, new patterns 
emerge. • 

Methodological techniques focus on^the methods, measurement tech- 
niques , etc., used in scientific inquiry. That is, methodological 

studies are designed to describe and analyze methods* throw light on 
their limitations and resources^ clarify their presuppositions^ and 
consequences, and Relate theif potentialities to the twilight zone at 
the frontiers of knowledge (Kaplan, 1964). Methodological research 
helps one to understand th$ scientific inquiry process itself rather 
than its. products." . .. 
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For what we are calling "clinical investigations" there are five 
^^t^ct neth?** that investigators have used. They have been called 
structured individual Interviews, Piaget f s "method clinique," the ^ 
teaching experiment i ethnographic case studies and. process-development 
evaluation. Mi the methods are characterized by the investigator being 
clinical* That is, he focuses on a particular phenomena as he attempts 
to capture essential features of the event, This implies the inves- 
tigator cannot be simply a "data cruncher." Instead he mat be in- 
timately involved with the event by observing it and quite often struc- 
turing it by the types of questions he asks. 

The s tructured individua l inter view has long been used in studying 
mthemBtical knowledge. Weaver f s (1976) selected reference^ on the 
topic begto in 1891 and continues today. Bechtel's study (1976) is a 
good example of this kind of investigation. He interviewed second 
graders by presenting them a structured set of physical division pro- 
blems. He limited his questions in a systematic way and videotaped all 
the interviews. All interviews proceeded in the same way. The be- 
haviors of all the subjects were then coded into categories and rela- 
tionships examined* 

._ _' >> 

Piaget's "method clinique" starts the same as the structured 
interview--with a carefully designed specific problem. It differs 
however in how the interview is carried out. In this technique the 
investigator is like a Freudian psychiatrist who probes the responses 
each subject makes. No two interviews are expected to prpceed in the 
same way. The behavidra are. -then analyzed and patterns examined. 

Like the two previous clinical, techniques the teaching exper-f™*nt 
starts with carefully designed problems. However^ * in this case rather 
than trying to discern pupil's knowledge or how they think the investi- 
gator is interested in how pupils learn or acquire hew knowledge. Each 
subject is his own control in that his later performance is gauged in 
terms of eariler pe^formance. Although not unknown in this country the 
"teaching experiment" has «been a primary research tool of Soviet re- 
searchers. For example, Krutetskii's jrecentiy translated wrk on 
mathematical "abilities summarizes voluminous information derived from ■' 
teaching experiments (1976) • 

The ethnographic case study in contrast to. the other techniques 
does not start with investigator control over the problem situation. 
Rather it is an attempt to discern the structure of naturalistic events. 
?^fl??thodoIogy has been borrowed from anthropology*— after all the 
anthropologist cannot restructure the culture he is studying. An 
example of this type of research may be found in the current Beginning 
Teacher Evaluation Study being carried out by the Far West Laboratory. 
Tikienof f , Berliner and Rest (1975) gathered ethnographic data on forty 
elementary classrooms while reading and mathematics were being taught. 



This set of references is in appendix A. 
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Process-development evaluation combines, some features of the 
leading experiment , ethnographic studies with more standard assessment 
procedures in a time- series design (See Romberg & Fox, 1976; and Fox, et 
al., 1976) • 

Researchers engaging in clinical investigations* most be able to (1) 
articulate the relationship (s) between their research and its theoretical 
base(s) and (2) justify the methods or techniques employed. 



The Clinical Investigation and Instruction 

Research on instruction could benefit by using clinical methods 
particularly teaching experiments and ethnographic case studies. 2 
Research relating to instruction focuses primarily on information pro- 
cessing variables of individuals (or groups) , personality variables, and 
learner- environment interactions • The 'nature of these variables is such 
that in aany instances they are better studied using idiographic tech- 
niques in a clinical setting rather than under experimental conditions. 
"Ctbnbachi realizing the difficulties of studying variables related to 
instruction, suggests the following approach: 

Instead of making generalizations the ruling consideration in 
pur research, I suggest that we reverse bxir priorities^ 
t An observer collecting data in one particular situation is 
in a position to appraise a practice or proposition in that 
setting, observing effects in context. In trying to describe 
and account for what happened, he will give attention to 
whatever variables were controlled § but he will give equally 
careful attention to uncontrolled conditions , to personal 
characteristics* and to events that occurred during treat- 
ment and measurement. As he goes from situation to situation 
his first task is to describe and ' interpret the effect anew 

in each locale, perhaps taking into account factors that 

were unique to that locale or series of events^ The special 
task of : the social sc ientist in each generation is to pin 
down the contemporary facts (Cronbach, 1975). 

eiinicai methods fit the approach described above and thus lend them- 
selves to the study of instruction. 

The ins true tioiuLl_ event is an interactive process and is not 

static. The variety of participation responses often changes the con- 
tent and direction of the event, some outcomes are often embedded within 
the process itself, each event is occurring ^thin , a larger and complex 
learning milieu, and the apparent content of the event shifts and changes 
when viewed from different personal and time perspectives. Presumably* 



Research on diagnostic principles could also benefit by using clinical 
methods particularly structuredinterviews or by using Piaget's 
"method ciinique." Romberg U977) has dS&lt with this issue in his 
other paper at this conference. 
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to understand what happens in an instructional event, one must have a 
description of the event itself which illuminates these characteristics. 
In particular, any event must be considered as a mixture and interaction 
of physical, social and moral-psychological environments . The physical 
space (time, place arid objects) J.n_which an everft occurs is suggestive, 
facilitating and constraining, with respect to what occurs. What people 
do and say to and with others both 'direct 1 observable behavior (reactions 
to planned actions and questions) and 'natural* observable behavior 
(naturally occurring 'free 1 actions and responses) are part of every, 
event. * Arid finally, the intentions of all the participants shape and 
give meaning for each individual" to each event. 



In studying instruction, the researcher's task is to discern the 
patterns of interactions in order to describe the course of events and 
predict effects. He uses theoretical constructs of social interactions, 
or operational categories based on an empirical examination of the event 
to identify patterns^ Also, effects are not just terminal outcomes* 
they include how ideas develop and change over time, thus, the central 
problem faced by researchers interested in studying instructional events 
is to attempt to capture the patterns of interaction which actually 
occur. * 

- • • . . ■ ~L 

Summary 

If one's knowledge about _diagnosis and instruction in mathematics 
is to improve, then we collectively most be more _imaginative in our 
approach to inquiry. Ofrr intent has been to stimulate you to^corisider 
an alternative method of inquiry—the clinical irivestigatiori— as a way 
of discovering practical propositions about what we know. 



Some Suggested < 



Conducting- Clinical Investigations 



1. 
2. 
3. 
4. 
5. 
6. 
7. 
8. 
9. 



Know your problem — "no brie goes in cold. 11 

Examine how others have carried but_ similar studies.. 

Plari_ to pilot ideas several times—be open to change. 

Talk^over ideas* plans, results,, objectives. . .with others. 
Assume that you will learn-—do better next time. 
Clearly define the role of the investigator. 



Instrumentation 

i. Determine what type of instrumentation (anecadtal profiles, rating 
scales* structured interview protocols, questionnaires , check 
lists, bbservatiorial systems i diagnostic tasks or*- probes, tests, 
etc.) Best fits the nature of your problems and your objectives. 
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2. Instrumentation should clearly reflect the constructs or theoretical 
rationale related to your problem and your objectives. _ 

3. Consider validity ([content * concurrent ahd/br construct) of instru- 
mentation. » 

4. Consider reliability of instrumentation. * . " 
5. 

6. 

7. ' J 

Ob serva t iona 

1. Clearly identify the dimension (s) of behavior or process to be 
observed.. 

2. Clearly identify subjects to be observed. 

3. eieariy identify the setting in which the observations are to occur • 

4. Carefully plan and by systematic in making 'direct 1 and 'natural* 
observations. 

5. Train observer (s) bh what and how to observe. 

6. Consider using video tapes and recorders. :_' _li 

7. Consider reliability of observational procedure through inter- 

8. Consider observing behavior (s) or process more than once — Time 
Sampling; 

9. "live" observations should be recorded immediately or as soon as 
possible. _ : 

10. Consider making provisions for recording unusual or unexpected 
behavior during observed event. 

11. 
12. 
13. 

Data Analysis 

1. Categorize data so thatit will "ref lect your problem and purpose. 

2. Hake sure you have a sufficient number of data categories. 

3. Hake sure your categories are independent. 

4. Hake use of tables, frequency distributions, graphs, etc. when 
possible. j 

5. Hake use of individual or group profiles if appropriate. 

6. Hake use of appropriate statistics. 
7. 

8. 

Writing Results 

1. Clearly state results— be specific^ 

2. Clearly relate results back to your problem and theoretical 
rationale. (How does your study advance the frontier of knowledge?) 

3. List hypotheses generated by study for future research (if appropriate). 

4. Identify unexpected patterns of behavior exhibited by individuals 
and/or groups^ '._ 

5; Be carefui-^don* t over generalize results of clinical investigations. 

6. v 

7. 

8. 3 0 
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the Use of "Individual Interviews" in Assessing 
Pupils' Mathematical Knowledge or Learning: 
A Chronology of Selected Illustrative References 

1. Hall, G. Stanley, Contents of children's minds pn entering school. 
Pedagogical Seminar y Is 139-173; 1891. 

2. Card,- Willis^;. A preliminary study of the psychology of reasoning. 
American Journal of Psychology 18: 490-504; October 1907. 

3. Judd, Charles Hubbard. Studies of number consciousness. Psychological 
Bulletin 6: 42-43; February 15, 1909. 

4. Buswell, Guy Thomas, _&* Judd, Charles Hubbard., Srnnrnnry of educational 
investigations relating to arithmetic . Supplementary Educational^ 
Monographs, No. 27. Chicago: ■ University of Chicago, June 1925. 

5. Buswell, G. f. (with the co-operation of Lenore John) « Diagnostic 
studies in ar*M™*tic. Supplementary Educational Monographs, No* 30. 
Chicago: University of Chicago, July 1926. 

6. Brownell, William A. The development of children's number^ ideas— in 
the primary grades . Supplementary Educational Monographs, No... 35. ■ 
Chicago: University of Chicago, August 1928. 

_ _ _ . ._ _ _ \ 

7. Brownell, W. A. The techniques of research employed In arithmetic. 
In Report of the Society's Co*™* ttee on Arit hmetic . Twenty-ninth 
Yearbook of the National Society for the Study of Education. 
Bloomington, It: Puibic School Publishing Co., 1930. (Pp. 415-4435 

8. Buckingham, B. R. , & Mactatchy, Josephine. The number abilities of 
children when they enter grade one. _ In Report of the-Society 1 ! 
on Arithmetic . Twenty-ninth Yearbook of the National Society for the 
Study 6f_EdtrcftldiK — Blo omington', IL: P ublic School Publishing Co* -j=-= 
1930. (Pp. 473-524> 

9. Buswell^ G. T. A critical s urv ey of previous research in arithmetic. 

In Report of the Society '1b Committee \m Arithmetic. TWeaty^ninth 
Yearbook of the National Society for the Study of Education. 
Bloomington, IL: Public Schbol Publishing Co.* 1930. (Pp. 445-470) 

10. Buswell, _G. T. , & John, Lenore. The ^bcabulary of arithm etic^ Supple- 
mentary Education&l Monographs, No. 38. Chicago: University of 
Chicago, January 1931. 

11. Brownell, William A. , & Chazal, Charlotte fc. The effects of prmature 
drill in third-grade arithmetic^ Journal of Educational Research 29: 
17-28, Supplement 1-4; September, November 1935. 

12. Brownell, William A. , & Watson* Brantley. The con^arative worth of 
two diagnostic, techniques inarithmetic. Jou rnal of Educational 
Research 29: 664-676; May 1936. 
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ii^iii- William A. (with K. G. Kuehner & W. C. Rein) . Learning as 

University Research Studies in Education, no. 3. Durham, HC. Duke 
University Press, 1939. - 

14. Brownell, William A. The evaluation of learning In arithmetic. 
In Arithmetic in general education . Sixteenth Yearbook of the 
St^wS of Teachers ot Mathematics New York| Bureau of 
Publications, Teachers College, Columbia University, 19*1. (PP- ™P 

is ' Brownell, William A. (with R. A. Doty & W. C. Rein). Arithmetic .in. 
!'°™. T «nd II: A critj-i & new and previously re norted 

research . Duke Universit y Research Studies in Education, So" o- 
Durham, NC: Duke University Press * 1941. 

ifi Bfdtmell William A. , & Carper, Doris V. Learning the multiplication , 
Sjoations. Duke University Research Studies in Education, No. 7. 
Durham, NCT" Duke University Press, 1943. 

Brownell, William A. , & Moser, Harold E. (with D- M-Frazer^ M^^^ KaJcr, 
J Hi Ostwalt, & J. F. Weaver).. Meaningful vs. mechatitral learning. A 
lr± "n^rade III subtraction. Duke University Research Studies in 
Education" No. 8. Durham, NC: Duke University Press, 1949. 

Buswell, G. T. Methods of studying pupils' thinking to arithmeti|.^ 
S^kc 1949 (compiled & edited by G. ^ Busweiy Itourtoe L grtung) . 
Supplementary Educational Monographs, No. 70. Chicago. University or 
Chicago Press, November 194^^(Pp^55-63) 
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18. 



19 Dawson, Dan T. , & Ruddell, Arden K. An experimental approach to the 
' SviSon i5ea. Arithmetic Teacher 2: 6-9; February 1955. 



20. Gunderson, Agnes G. Thought patterns of children in learning ^^955? 
cation fend Klementarv School Journal 55: 453-461, April 1393^. 

21. Weaver, J. Fred. Big dividends from little interviews. Artohmetl & 
Teacher 2: 40-47; April 1955. ; , 

99 Rnsweil Guv T. . & Kersh, Bert Y. Patterns of thinking tn solving 
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Gibb E. Glenadlne. Children'* thinking in theVocess of subtraction", 
^lioftoer^tal Education 25: 71-80; September 1956. 



24. Van Engen, Henry, & Gibb, E, Glenadine. General mental functions 
IS^f^d with division. Educational Servic^Studie*. No. 2. 
- Cedar F^lls: Iow » Stste Teachers College, 1956. 

* • ... - 

n1 » nH __ Herbert T. . & Brown, Betty Irene. A research in mental 
25 * arctic involving subtraction. *Tnnrn,1 hf durational Research 
53: 97-102; November 1959.; 
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26. Ruddell, Arden K. Levels of difficulty in division. Arithmetic 
Teacher 6: 97-99; March 1959. 

1 

27. Face^ Angela. Understanding and the ability to solve problems. 
Arithmetic Teacher 8: 226-233; May 1961. 

28. Brownell, William A. Arithmetical abstractions: Progress toward 
maturity of _cbncepts_ under differing programs of instruction. 
Arithmetic Teacher 11: * 547-556; December 1964. 

30. Brace, Alex, & Nelson, L.Doyal. The preschool child's concept of 
number; Arithmetic Teacher 12: 126-133; February 1965. 

31. Gray, Roland F. An e^etiment in the. teaching of introductory multi- 
plication. Arithmetic teacher 12: 199-203; March 1965. 

32. Gray^ Roland F. An_ approach. to evaluating arithmetic understandings. 
Arithmetic Teacher 13: 187-191; March 1966; 

33. 4 Hervey, Margaret A. Children's responses to twp types of multiplication 
problems; Arithmetic^Teacher 13: 288-292; April 1966. 

34. Brownell, William A. Conceptual maturity in arithmetic under differing 
systems of instruction. Elementary School Journal 69: 151-163; 
December 1968. 

35. Kiipatricfc* Jeremy. Analyzi ng the solution of word problems in 

mathematics.: — ito-ea^ lbfatbry s t udy . Unpublished doctoral dissertation, _ 

Stanford University, 1967. ( Diss e rt a tion Abstracts 28: 4380A; May, 1968. 

36. Rea, Robert E. , $ Reys, Robert A A iteth^tical cdmpetenc of 
entering kindergarteners. Arithmetic Teacher 17: 65-74; January 1970. 

37. Reyf, Robert E. , & Rea, Robert E. The Comprehensive Jfethematics 
Inventory: ■ An experimental instrument for assessing the mathematical 
competencies of childrin entering school. Journal for Resear c h in 
Mathematics Education 1: 180^186; May 1970; 

38. Lankford, Francis G. , Jr; Some computational strategies of seventh 
grade pupils. Final Report, Project No. 2-C-013. U.S. Department of % 

'/ Health, Education^ & Welfare, Office^ of Education * National Center 
X for Educational Research & Development, and Center for Advanced 
*tudy, University of Virginia. October 1972. 




39. Grouws^ Douglas A. Open sentences:. Son« instructional considers 
search. Arithmetic Teacher 19: 595-599; November 1972. 
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40. Pereira, W. A study rel a ting -girls* overt ^verbalization performance j 
detention, rules and strategies as they learn a mathematical structure 
based on elements of a potential theory which relates thinking language 
and learning . (Technical Report No. 293.) 1973, Wisconsin Research 
and Development Center. 

_ _ _& _ . _ ... . 

41. Becjitel, R. S. & Weaver, J. F. A preliminary investigation of th e ab ility 
of second-grade children to solve divis ion problems pre s ent e d in a 

physical-object mode and in different . partitive-m e asure ment sequencer 

(Working Paper No. 194.) 1976, Wisconsin Research and Development Center. 
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A Clinical Model for fitagnosing Mathematical Deficiencies, (MD) 
Incorporating Biucational Cognitive' Style 



William R. Speer 
Bowl lag Green State University 



One of the most significant movements toward improved instruction 
that has been made in recent years is that of incorporating into the 
instructional _ setting plans for diagnosing learning difficulties and 
detecting heeds for preventive and correctiye teaching (Engelhardt, 
197*t 1976? Irons, 1976). In fact, *the t4rm ''diagnosis 11 and its 
variety of meanings have become part of the vocabulary of mathe- 
matics educators, with some notable exceptions, at all levels of 
instruction (Crenson, 1976 )o As an example, consider tae Guide- 
lines for the Preparation of Teachers of Mathematics (1973) published 
by the Commission on i>reservice Bta<^iott of Teachers of Mathematics 
. of the National Council of Teachers^ of Mathematics which put forth 
• recommendations that included the attainment of competencies in 
"recognizing stages of cognitive, affective, and psychomotor develop- 
ment in* children and individual differences between children as' 1 , 
these differences pertain to the learning of mathematics," (p. 15) 
as well as in diagnosing and. prescribing '•remedies for common dis- 
abilities in the learning' of ii^athematlcs and to know what tooire '. 

and techniques axe available to help with diagnosis and-correctton"- 
(Po ±5 ). \ 

Nevertheless, when the literature deal ing with the diagnosis 
of mathematical difficulties is examined, one finds "a paucity of 
relevant research and a lack of substantive, contributions ,v (Cawley, 
1975* Po 12). "Research, in the , maln» has been perfunctory at test 
and dissemination almost non-existent" ( Crenson 1976 i pi Sill ier 
(1970 ) , In the Nattonal Council^ of Jteacfaers of ^tefe^attcs B4^ty-"_ 
Second Yearbook, reported ^a study^whlcdi categortzed research- studies 
in mathematics education made in Hie Uhlted States between 1886 and 
1963o The category focusing on diagnosis cpntained a total of on^y 
103 entries, which in graphical form, reflects a "bimodal distribution 
with the modes appearing in the late 1920* s and again in the early 
19*RJ f s. A similar study by Suydam (1970) located a total of 107 * 
studies focusing on diagnosis and/or remediation for the period 

ranging from 1900 to 1965, ^ 

research in mathematics education, stated that any search of avail- 
able resources 

readily reveals that the type of work I f ve called 
clinical intervention /guiding efforts in diagnosis 
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and treatment of children's learning difficulties 
In mathematics/ Is either not recognized _as research , 
or is depreciated as research, and In some circles 
even deprecated as research,, (Wilson, 1973i PP« 1-2) 

Several recent calls for needed research appear to "be having 
an Impact Kith respect to generating new ^interest in research and 
application of diagnostic models (Gray, 1972; National Advisory 
Committee on Mathematical Education, 1975 i National As$^sment of 
Educational Progress, 1973; National Conference on NdeSed Research 
in Mathematics Education, 1967; National Conference on Remedial 
Mathemsticsi 197^ 1975i_3£76}. A c^^ory e^raml^ation of recent 
National Soqncli of ^Tea^ers of Matoematlcs regloml and national 
meetings indicates eaq>anding attention to the diagnostic-remedial 
arena. State governments also provide impetus, for further gains 
the passage of laws such as Section 230, 2311 of the Florida _ 
Statutes (1975) which states, in parti that each school district's 
program shall Include an individualized diagnostic approach to 
instruct! on 0 * , 

Soteblyjaie ^70s wlUjfi-taess a kindling of 
efforts "by a nattonai cross-secttonai group 
of in dividual s from diverse institutions repre- 
senting isolated efforts in diagnosis in clinics 
and teacher training programs . The most iden- 



tifatle catalyst In this "mcfvemeffEis^ the effort 
of Jim Heddens'at Kent State tfciversi^ who* 
through the kelp of the KEDS General Assistance 
Center , has or^snizgd three i_i«j&gnarl conferences 
with diagnostic themes, (ttaderhiiii 1976^ p. 1} 

in his summary paper of the first National Conference 
on Remedial Mathematics, stated s 

Many participants commented on the level of 
knowledge that exists in regard to diagnostic- 
remedial procedures in mathematics. It would 
seem fair to say that there is not a great deal 
of systematic j accumulated knowledge. Some 
smatherings of research evidence and some sensi- 
tive and. insightful thoughts on the subject exist. 
Some isolated Individuals at various points in 
time have attempted to pull together some of the 
research and thoughts," tut the level of scientific 
knowledge regarding the diagnostic-remedial episode 
in mathematics is not great. (Callahan, 197^* p. 3) 

Many examples have been used to cite this apparent lack of 
concern for providing a sound knowledge base for research on 
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diagnosis (National Conference on Needed Research In Mathematics 
Education, I967). What Is perhaps more Important Is why this state 

of affairs exist s« Etagelhai^t (1974) proposed ^"toee major fectors 

as possible explanations. These are (l) M an InsufflctOTt understand- 
ing of the 1 e a ri ilng process," (2) "fee disjointed natulre of most 
research efforts," and (3) "the apparent lack of theoretical models 
for mathematical remediation, models which would Identify sets of 
variables to provide a common focus for ^search" (pp. 2-3 )• These 
three factors provide the framework for this paper. 



The purpose of this pa^r is to desaibe a theoretical model \ 
for -Hie clinical dlagnpsls of mathematical deficiencies — a model 
which is compatible with and built upon research an^s u pp o rted by _ 
theory q The research base for a study of this nature is not confirma- 
tive (i.e., one which is experimental) but rather It is generative 
(i.e. ^ one which generates hypotheses) and analytic-synthetic (i.e., 
one .which constructs guiding models and explanatory theories) (Wilson, 
^973)o 

gpecif Ically , -fee model focuses on three considerations, namely, 
the identification of _ specif i^matoematical deficiencies, the iden- 
tificatton of mathematical cognitive styles and the identification 
of general educational cognitive style. __ fhe model is designed and 
developed primarily' for use in a clinical setting. 



Identification of specific mathematical deficiencies, refers 
to the process of determining, by various forms of examination the 
specific nature and circumstances of a mare general, suspected ^defi- 
ciency. For the purposes of this peeper the diagnosis of mathematical 
deficiencies^is ainibed to the concept clusters represented by the 
Kent State tiifversity Mathematics Checklist (1975 It is important 
to note, however, that the possibility exists for the extension of 
this model into other areas and levels of mathematics. Indeed, if 
this model is to provide any significant contribution to the field 
of diagnosis it . 1st have this property. "The creative aspects of 
mathematics, skill in searching out mathematical patterns, non-routine 
problem solving, and the study of functional relationships ljust be • 
considered as carefully as the skill aspects'" (Riedesel, 197^, p. l). 

Mathematical cognitive style is viewed as the maimer in which 
an individual operates on the concrete~representative--abstract 
hierarchy in light of mediating variables (i.e., visual ^ auditory, 
tactile) encountered in both the mode of presentation and type of 
desired student response. 

Educational cognitive style, as it is used in this paper his 
its foundation in. the work-drone by Hill (1968, 1972, 19?*). : 
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' /Informally, educational cpgidtive s^le is the way In which an Indi- 
vidual takes on meaning, the way . in which an individual perceives 

"his surroundings, the way in which an individual can master an 
educational task most readily (Hill, 197^)o 

^mpoae of^ixe pap«c^ then, is to cmbine the three factors 
of mathematical diagnosis, mathematical cognitive style, and educa- 
tional co^itive style into a model and instrument which can be used 
to generate a map of the * individual student. This map can then be 
used in a prescriptive sense to determine the most probable means 
bfi providing successful corrective teaching 0 

Theoretical Framework 

One of the assumptions of this is that "man is not 'content 

with biological satisfactions alone, but rather he continually seeks 
meaning 1 ' (Htll#_197^f P* 2)# She implication 1st of course, that^ 
we are inherently curious and constantly searching* for reasons and 
explanations' which give meaning to our environment as we perceive 
it L . The, fruits of bur search for knowledge and . underst^ding , , in 
this Instance, are represented by a profusion of theories and models 
which attempt to explain various aspects of the educational arena. 

Some theories are f d^ulated on the basis of patastaking ^bbsacva-* 
tion and categorization — what has been called "confirmative research" 
( Wilson § 1973 )^ The foundation of such theories lies In the ^thering 
of experimental data which is then used to develop classification - 
schemata. In mathematics, ±*or example, this is akin to the inductive 
reasoning process used by elementary school children who generalize, 
after several experiments, that the sum of two even > numbers is an 
even number. 

Other theories are predicated on the basis of rational analysis. 
That is to say, a general theory is put forth, based on certain 
assumptions, and then "experiments" or observations are made to see 
whether or not they fit the theory. Essentially, this is the process 
called "empirical mapping" by Hill (197*0, or "generative research^ 
by Wilson (1973). An example of such a'* process can be found iq the , 
works of Piaget (1952). ^ 

ite im p ortan t chaoacteacistic of cd^iamative or experimental 
research has been described by Mouly. 

Experimentation/ whether in education or any other - - 

field, rests on the assumption that there exist 

invariant relationships between certain antecedents 
and certain consequents so that, provided a given 
set of conditions prevail, if one does this , that 
wiH follow. (Mouly, 1968, p* 6)i 
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But, exceptions to the '•rule" do exist. In education It Is paxtlcularly 
easy to rationalize these exceptions into oblivion by calling on some 
unusual circumstance as the cause of the unexpected exception. In" 
many instances, of course, there may indeed "be some "unusual circums- 
tance H acting* The multitude of variables Involved in many ^educa- 
tional studies surely increase our chances of overlooking an important 
factor. • 

The difference between what was planned and 
actually occurred is considerable. Furthermore K 
this difference is Intended. Corrective instruc- 
tional events are not mechanistic routines to 
be biindiy _f oiiowedo Read everits grow, change 
s^id develop as the human beings Involved in the 
event interact. (Romberg, 3$7& , ps 3) 

Nevertheless, this technique bf irationaliziiag ide 
tions sometimes amounts to little more than burying our heads in 
the sand. About the best that can be said is that experimentation 
in education has produced a number of generalizations , principles, 
and laws which are valid under certain stated conditions (Van Dalen, 
i966| Romberg, 1976). 

Information gathered in the name of rational analysis, personnal 
*9 intuition^ or opinion has the same charoctertstifei A 
great deal. of the "knowledge' 1 we possess relative to our students has 
been defriyed through Informal observation y and consequently geheralissa- 
tions, /principles, and laws formulated in this manner are valid under N 
certain stated conditions. It appears, at least to the r author, that 
when we deal with the M less tangible, 11 less experimentally oriented 
aspects of education the re i s little difference between the experi- 
mental and experiential approaches , except perhaps that in the 
experiential model we do not try to rationalize inconsistencies into 
oblivion (NUnnalOy, 1975). 

Instead of making generalizations the ruling 
consideration in our research, I suggest that 
we reverse, our priorities. - An observer collect- 
ing data in' onejartlciLto sltration is itf.a 
position to appraise a practice or proposition 
in that setting, observing effects ' in context. 
Txi trying to describe and account f 6r what 0 
happened, he will give attention to whatever 
v r . variables were controlled, but he will. give 

iequally .careful attention to uncontrolled ; 

conditldxis,* r to.,l>ersonaI characteristics, and 

to events that occurred during treatment and * 

measurement. . As he goes from situation to 

situation his first task is to describe and , ' 
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Interpret the effect anew in each locale, 
perhaps taking Into account factors that were 
unique to that locale or series of events 0 
(Grorfbach, 1975 t Po 117) 

This Is essentially what Romberg ( 3976 } cabled "grocess^ evaluation " ; 
"larocess" in the sense that the^ focus is directed toward actions* 
as oppose^ tc_ oi_tccau_ts| and "valuation" in the sense that it is a 
question raising search rather than conclusion drawing research ° 

Wilson summarized the position of research of this nature in 
the following manner. 

The reasons f ar neglecting the sy stema tic develop- 
< 5 ment ax^d use of el jq 1 nal jjitg^en'tton-as a type 

of research are varied and have deep historical » - 

roots. Of &ose lAtcb are most often mentioned 

-to me, the most common are that "such studies 

aren't i rigOT6us il % "they don't tiro controls", 

"they use procedures and data that don't lend 

themselves to the analyses of inferential statis- 

■ ties." , ^rou can' t generalise frcm, one child or 

even a small group so studied", "there is no **ay 
to replicate", etc. 

Such criticisms are based on artterta aj^bpriate 
to experimental research. _ Par studies that are 
labeled as experiments and Intended by the re- 
searcher to fulfill the purposes of experimental 
research, such criticisms are, of course, accurate 
and fully justified. ~ 

• That studies which do _not_date_to_.be experiments 
are also criticized on these grounds~if only 
impiicity~attest to the eminent position the 
criteria of excellence in experimental research 
have attained In bur community. The high esteem 
we have far cbazrectly _ designed and executed experi- 
mental research is fully justified—far -bhe purposes 
to which experimental research is suited. A some- 
what comparable ^and justified esteem is held for 
- * sound ccxral^^ But is It jpossibie 

this esteeoa has^ obscured our clear recognition of 
the potential value of other kinds of research? 

In turn has th1 f^Hnhlblted our efforts to Improve ■•?. 
other kinds of research? (Wilson, 1973» P« 2) 

One often hears, particularly ln T educational cont_act___ itet 
theory and jxractice are not erven related, let alone , isomorphic 
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( Newsome ii§6^). Others^ taciuding-the author,, do not a^&& wi-hh 
this position* Reys and Post (3573) stated that, "Facts play a 
central role in the development of theory, and the theory subsequently 
provides a systematic interprstation of the general area to which the 
facts are related" (p. 16). Hill stated that 

ft is a serious mistake to think of a realm of 
theory that is separate and different ft am the 

reato of feet • It would "be reasonable to say 

either that facts represent one Jcind of theory 
or that theories represent one kind of feet, but 
most reasonable to say that fact and theory 
represent different degrees of what is basically 
a single process. (Hill, 1963$ p. 23) 

Burns (I962) suggested thai the nature of the relation between 
theory and practice can best be described by "pragmatic implication" 
which he .defines as "a rational ^person with _cerfcato ^Uefs relevant 
to certain kinds of situations generally acts in accord with those 
beliefs" (pi jftjo Gulrtchen (1966) took exception to Burns' approach^ 
mainly because the terms '^rational" and '"relevant" seem to leave too 
miich room, f or dif f ereht intea^retatiSni He did* however * allow for 
the possibilities, of action according to pi^gmatic implication in 
such areas as medicine or engineering. 

Gowin (I963) posed the view that theory is a blend Ing^of logic 
and facts amd that J.t is best seen as a guide to thought and Inquiry. 
In other words, Gowin points to the true iiatu^e^ of the relationship 
between the strategies of studies done in an experimental vein and 
those founded on rational analysis. Parkinson preferred to 

couch educational theory in terms of a strategy-— what Gowin (1964) 
referred to as a flow chart to guide experimentation • 

Clements (1962) described two basic types of theories, namely 
'•prescriptive" and "descriptive." Of these two, the former repre- 
sents what is general! y nailed ''edu^-U.onal theory i" According to 
Soltis (1968), "Descriptive theories are adequate when they allow 
for accurate ^edictions- and little, if any, educational theory is 
now of this sort 1 * (po 85). 

TWo opposing views are presented by Reys and Post (1973) and 
Newsome (196^). Reys and Post contended that, "Ideally, theories 
should provide insight to both theorist and practitioner concerned 
with a common area of investigation" (p. 17). Newsome, on the other 
hand, argued that the relationship between theory and practice is 
negligible. Theory does allow for better understanding of practical 
situations, according to Newsome, but it does not describe a set 
of logical processes to be applied to any given situation. 
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Whatever the organizing foundation for theory may be* the 
development of the general principles and laws contained within the 
structure : of the theory provide us with the means tb_at least attempt 
-to predict and control events in our surroundings* The degree to 
which we have predictability and control is dependent upon several 
factors Including "goodness of fit (how much agreement th^re ls_ 
"between the model ed the phenomena it is^ttempting to describe )i 
"reifcvance" £tfae degree iso^rhich the ifreory matches other charact- 
erizations^ parttcmlaaay those^that have "checfced out") and "fruit- 
fulness " (the development of checka.ble characterizations beyond 
those already in existence ) 0 



Golladay, De Vault, Fox, and Sfculdt (1975) identified problems 
in empirical research in mathematics education. It Is argued that 
it Is often difficult to choose "appropriate conceptualizations and 
measures for a varied of ph^aaena" (p* 159) found in the study of 
individuals and individual differences, _Further, "models of more 



banal, structured educSattozial e^eriences are not appropriate 
for. examining the -greater variety of opportunities and experiences 
characteristic of most individualised programs" (p. l6o)« A call 
Is made \for the use of paradigms, i,e 0 , descriptors, to identify 
categories and relations .with the intent of organizing observed 
data* They pointed to the successful use, by the scientific com- 
munity, of paradigms but quickly draw from a study by Apple (1973) 
which In^cated ttet while educators often employ paradigms they 
are seldom specifically stated^ 



GoS^aday et alj also pointed to the problem of reliability 
in studies Twhich focus on the individual. The major cause is the 
complexity of events which are presented to the observer, Ihey 
concluded that 

_.\ 

It\ may well be inappropriate to search for 
t«^ti<»ial method^ for testing the reliabiiity 
of 'information when the program being studied 
departs from traditional patterns ... ami in- 
formation is gathered in a manner different 
" v that of traditional research des 



from 

(Goiladay et al M 1975 1 P. 168) 



Since the 
model for _ use in 
and Identifying! 
•Hie notia as pres 
an additional w< 
developing an 
0VOTsimp3if icat; 
theory) useless J 



present paper is concerned with the development of a 
diagnosing an individual's mathei^^cal deficiencies 
Individual educational cognitive s*tyie^ it seems ; that 
ented in the previous pages, are relevant • However, 
of caution is necessary. An inherent danger of 
rteative model (or theory , for that matter j is 
on to the point that distortion makes the model (or 
On the other hand, presenting a model (or theory) 
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which incorporates all of the complexities of the situation under 
study runs the danger of 'being too copious to allow for practical 
application* 

Mature of Diagnostic Models 

Diagnostic models are of teree varieties in terms of tee setting 

in which the_ diagnosis is to take places namely , models that are 
classroom oriented^ models designed for clinical use, and models 
which may he applied to either environment. The primary emphasis 
in this paper is on clinical models since the (MD)2 model Is of this 
typlo 

Diagnostic models can also he differentiated on the "basis of 
their assumptions concerning the p urpose of diagnosis and Its cor- 
responding methodologies* 

One type _of models tee ahij±§ d raining models has as its 
purpose the identification of learner capabilities which* when 
identified , may he used to prescribe corrective teaching (Uprlchard, 
Baker § Dlnkel & Archeri 1975)* Thus* ability training may be roughly 
equated with altitude-treated which "seeks to 

provide a basis for employing differential treatments In order to 
exploit the cognitive preferences displayed by different individuals 
for differing content or mode of instruction" (Hancocsk, 1975 1 P» 37)* 

Some objections to tee use of tee ability t raining model that 
have been cited include t (1) the nature of the operational defini- 
tions used, (2) tee difficulty of incorporating ATI findings In the 
instructional setting! (3) the instability of {reliability. and validity 
measures of instruments usid to gather data, and (4) tee lack of 
research which supports tee notion that remediating weaknesses In 
cognitive preferences leads to Increased performance in the class- 
room (Stiglmeier, 1972; UpAchard et alii 1975)* 

"_ ^chrcf^^»se~ob jecSras^ffliJbe countOTed by inferring to tee 
available literature. For example i~^je73t±ons-one^^ 
dispelled by providing a scientific framework for education and 
the accompanying means of implementing this framework in educational 
settings tBlll* _197^)._ Objection three has been discussed at great 
length (ffl.ll, 1973) and poses no problem provided results are properly 
interpreted. Concerning objection four 9 it has teen stated tfaat t ^ 
"tee lack of productivity in this area has been ascribed to inadeq- 
uacies In research design and general methodology" ( Cu nn i ngham j 1975 1 

p. 171} i HDwever^. there now_exists an abundance of research which 

reflates the objection that application of ability training techniques 
does not increase achievement • Not only has it been shown, that 
remediating weakness in the child 11 s cognitive preferences leads to 
increased performance in learning situations but also it has been 
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shown that remediation based on utilizing the child's cognitive 
preference strengths has similar effects (Hadlke. 1973 )• 

The second theoretical model for diagnosis is known as the task- 
analysis model. Sis content oriented method consists of "analyzing 
a learning task into a hierarchy of subordinate tasks , diagnosing 
the pupils 1 mastery of the subordinate tasks r giving instruction 
in the specific subordinate tasks not master, py the learner" 
(Callahan S Robinson, 1973f P« 579). According to Uprichard et al. 
£l975)t In task analysis "the emphasis is on co^onent ^ciiis and 
their integrsti^into complex t erm inal tasks rather than the pro- 
cesses that presumably underlie the development of specific tasks" 
(P. 2). 

Identified csxribticjisms of this model include f (1) the content- 
orientation may cause the diagnostician to overlook Important factors 
in the student, (2) the task analysis of certain subjects is dif- 
ficult. (3) the validation of hierarchies is a difficult process, 
and (J*) the prescriptive philosophy of task analysis tends to be 
founded on changes in the curriculum, f or jfche most^art ignoring 
changes which reflect analysis of the learners.' cognitive style 
(Iferichard et al., 1975 )• 



Despite these criticisms several studies have pointed to the 
value of the task analysis model* Far example, Uprlchard et al 0 
(1975) stated that "the task analysis model has appeal fix JGfcthe- 
matic§7 ^u<»tors since the structure of the discipline aids in the 
building of hierarchical relationships. . . . /Tt7 la valuable in that 
the diagnostic finding rely on feweo 1 undefined and unvalidated 
assumptions" (^pi 2). Additional benefits of the task analysis model 
have been suggested* 

One conjecture is that a procedure of diagnosis 
and instruction based on a hierarchical analysis 
or subordinate tasks is an effective procedure 
for students 1 learning of a mathematical taskii.. 
- Another con jecture is tha* where liie task analysis 
procedure is used in the teaching of a mathema- 
tical ta^ the incidence of t^OTachievemeirt j.a 
will significantly decrease. . • □ In summary, the 
task-analysis procedure when combined with mean- 
ingful mastery learning of the subordinate tasks 
in a hierarchy seems quite effective in learning 
a mathematical task. (Callahan & Bobinson, 1973 t 
VP. 58>58f) 

It ^oiild be^_noted at this point that the model described in _ 
this paper is^ synthesis^of both the ability training and the task 
analysis theories of diagnosis. The Model for Diagnosing Mathematical 
Deficiencies is designed to provide Information about student style 
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as well as content deficiencies* The corrective teaching procedures 
suggested by the model Include not only revisions <• in content but 
also in modes of Jjistructlon to better match the Individual's unique 
cognitive preferences « 

Another method o^differentiatii^ between diagnostic models is 
"by identifying their research base, specifically^ by refe r r ing to the 
manner in which the various theories of diagnosis are developed, 

. •_ N_ _ 

Wilson (1973) described three major classes of research* The 
first, confirmative research, Is experimental In nature and centers 
on "activities designed to assess the truth of probable hypotheses" 
{p* 11). The second, analytt^syn^etic research, deals with "activi- 
ties Involved in the development^ 

theories" (psH)i Thirds gene^tive researdtLis braed ©^"activities 
consistent with the postulates of science designed to generate 
hypotheses with an a priori probability" (p» 10). Generative research 
Is further described by Wilson In terms of two subtheorlest (1) 
normative research with "activities designed to .generate hypotheses 
concerning facts and those connections between facts which exist in 
nature" (p* 16). and (2) clinical Intervention research which Involves 
"artiyities desired to gene^ 

between facts which might be brought into nature by some intervention" 
(Pc 16). 

Hie model described in the present paper, the ^f»t^T Model 
for Dlaghosing_ Kathematlcal Defl^eh^es^HD^ has a research 
base which Is both, generative and analytic-synthetic • Aptitude^ 
treatment-interaction theories are also founded on the generative 
research approach by nature of their study of the relevant processes 
engaged In bg^ students in learning situations with the intent of 
generating ^rpotheses concerning these processes _(]ttttrocki 197^)« 
Much of Piaget's work has centered^on this same form, of research* 
Plage tian- type research has impelled us to 

take a fresh look at our field and to ask a 
host of new questions concerning the nature 
of developmental stages and of developmental 
processes generally, as well as of the kind 
of research approaches which the study of 
these problems demands. In so doing it has 
^^ff^ appr ecia te "toe important place of 
systematic theory in an ^e^of^develbpmOT-- 
tal research, essentially comparative In 
nature, which has not always been noted for 
its theoretical sophistication. On the other 
hand, the theoretical significance of research 
Inspired by Piaget 9 s\ Ideas does not prevent 
It from having direct and important relevance 



for the resolution of practical questions of 
pedagogy and educational practice • (Wohlwill, 
1968 1 p. 446) 

To summarize, diagnostic models can be differentiated in terms 
of ^efoer they f octis on classroom and/or clinical procedures j on 
whether they are abi 11 ty- train 1 ng or task analysis oriented, and 
on whether they have a research base which is confirmative, genera- 
tive, or analytic-synthetic. Those different approaches to the 
diagnostic-prescriptive arena do hot necessarily reflect differences 
on what diagnosis is, but rather on how diagnosis is to be carried 
out* 

M a ture of Educational Co gni t i ve Sty l e 

- 2 

Before discussing the (MS) models it is necessary to examine 
one of its components in some detail. This component, educational 
cognitive style , is hot content oriented, towards mathematics but its 
: usefulness in the prescriptive stage will readily become evident. 

There will be a great change made in the first 
and foremost > and continuing business of society* 
the education and training of the youngi The 
development of -tee mind of the child will cane 
to rest in the knowledge and skills of the bio- 
chemist, the pharmacologist! and neurologist,. _ 
and psychologist, and educator. And there will 

be a hew expert abroad in the lJuid~the psy- 

choneurobiochemeducator. (Krech, 1969, p« 374) 

While the ••new ^ exper^" that Krech refers td may st^l be some- 
what futuristic, advances have been _made to develop a more scientific , 
but not less i^an^tic^ ftemework for education. The most notable 
of these efforts" falls under the auspices of the American Educa- 
tional Sciences Association and its founder, Joseph Hill. Since 
its inception in 1971 (Hill^s first published work ih_this area 
was in 19663_its membership has^grbwn to over 25Q_(AESA Membership 
Eirectbry*_1975) ani a recent AESA bibliography (Berry, Sutton, & 
McBeth, 1975) included over 300 entries on various aspects of ^the 

Educational Sciences. Also, the educational science of cognitive 

style has had considerable impact on educational programs x at ai^ 
levels and has been adopted by many school systems. It is recognized 
that shear numbers are no indication of the value of any organization 
or cause « This data is provided only for the reason that it dispels 
any thought that knowledge of, and development in, the Educational 
Sciences Is limited to a select few. 



The following quotes suggest the rationale for the development 
of the Educational Sciences. 
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American education presents to the public view 
idle spectacle of a house divided against itself* 
Che needs only to persue the bade copies of 
educational journals to see how the battle has 
raged, and to observe the disarray of the schools, 
Rich conflicting point of view finds its advocates. 

It is obvious that the confusion and disarray In 
education arises from the lack of commonly agreed 
upon goals, practices, and definitions o In other 
words, instead of having a common framework and 
a ^common language^ educators have developed an 
amorphous collection of ideas, concepts and methods 
from a variety of other disciplines 0 (Radike, 19739 
Introduction} 

Without a framework of 'language', the vast field 
of human activity called ^education' does not 
readily lend itself to meaningful description or 
definition. At the present tlme 9 the Universe of 
discourse assodLated with education lafcks precision 
beyond that found at the _ levels of common sense 
and dally journalism. The difficulty with such 
language is not that it fails to proviSe a foci 
of communication , Jnat that the possibilities of 
misunderstanding are great and che probability 
of relatively precise discriminations and predic- 
tions is small. (Hill, 1968, p. l) . 

educstt^ 

and ca^cnly understood meanings L when jfords such 
as 'democracy* , 'education 1 , ' curriculum ' , and 
•discipline 1 are used by different workers in the 
field r they may stand for slightly or radically 
different things. In contrast, the technical 
terms in the exact sciences such as meter, ampere, 
Ughtyear, and calorie are instruments of great 
exactitude. (Tan Dalen, V)66 , p. 200) 

These exact sciences referred to ijy V*m Ztetien *® equated 
to what SH refers to as * fundamental disciplines" (ittHi 3$7*h 

Fundamental disciplines are bodies of knowledge 
generated by communities of scholars that pro- 
duce pure and distinctive forms of information 
about phenomena which they study. Biology, 
history, art, psychology, and mathematics are 
examples of fundamental disciplines. 
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Gdmplementlng the fundamental disciplines are 
the applied or derivative fields of knowledge a 
These bodies of information are generated by 
practioners who deal Kith practical considera- 
tions of the human ccra^tion« Ifedlctoet phaxmacy, 
engineering, and law axe examples of applied 
fields of knowledge, (ffl.ll, 197^f p. 1) 

Education is not a fundamental discipline but instead is an applied 
or derivative field. The Educational Sciences represent an attempt 
to describe a conceptual framework for education that is as precise 
and definite as that found in other applied fields* According to Hill, 

With the developaent of the ^u^tional Sciences, 
the solutions of problems and explanations of 
phenomena are facilitated, and educational prob- 
lems accuring to inadequate Sommunication, mis- 
inte^xretatibn of Information, _ and, fragmentation 
of effort are alleviated* (Hill, 197$$ P« 1) 

Presently there axe seven educational sciences* These include t 
(l) symbols and their meanings, (2) cultural determinants of the 
meanings of symbols, (3) modalities of Inference, (**) biochemical 
and electrophysiological aspects of memoafy, (j) cognitive style of 
in^vidiials, (65 teachia^s-jyiesi administrative styles and counsel- 
ing styles, and (?) systemic analysis de^sionnniaking* The fifth 
educational science, cognitive style of Individuals,' includes the 
first three educational sciences (the fourth is not sufficiently 
developed at this point)* Therefore, far the purposes of this paper 
the discussion -will center on the educational sciences of symbols, 
and. their meanings, cultural determinants,- and modalities of 
inference, i.e*, educational cognitive style* 



Qassroom teachers_have long been aware that students come to 
know what they know in their own unique way* ttatll recently* however , 
there was no established framework for teachers to analyze the learning 
habits of their students and match them with the "most appropriate" 
mode of Instruction* Educational cognitive style provides such a 
framework* \ 

Brieflyi e^cattonai cog&t&e^1&jt& is a means of l&ntfcfying 
the ways _tn _ which an Jta cU^dual perceives and reacts to the environ- 
ment* An individuals 1 cognitive style \s the way a student tends to 
seek meaning and the manner in which information is personally^ filtered* 
Cognitive styles axe influenced by the wayfc. in which Individuals 
derive meaning from symbols related to theirxpersonal experiences and 
• the world about them; the influences of f amlH^ friends , and their . . 
own individuality on these meanings; and the kind of reasoning processes 
used to derive these meanings* \ 
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A BRIEF GUIDE TO COGNITIVE 
Symbols and Their 



STYLE MAPPING 



Reprinted with permission from Joseph Hill (1976) 



Two types of symbols, theoretical (e.g., words and numbers) ( 
and qualitative (e.g., code data) are basic to the acquisition ' 
of knowledge and meaning. Theoretical symbols differ from 
qualitative symbols in that the theoretical symbols present to 
the awareness of the ind iv i d ua I someth ing d iff ere nt f ro m 
that which the symbols are. Words and numbers are 
examples of theoretical symbols. Qualitative symbols are 
those symbols which present and then represent to the 
awarhess 5f_tte_iritijvidU3l that which the _J? ft P9\ I s ! 
(Feelings, commitments and values are some examples of the 
meanings conveyed by 'cne qualitative symbols.) 

There are four Theoretical Symbols: 

T(VL) Theoretical Visual Linguistic — ability to find 
meaning from word s_ you Ljsee._A major in th b 
area indicates someone who reads with a better 

than average decree of comprehension. 

t(al) JP^A^^^J^P^ri . ^Mnft^lfe" _r_ akflity jo 

acquire meaning through hearing spoken words. 
T(VQ) Theoretical Visual Quantitative — ability to 
_!"??h1ng in. _^?mi jot numerical symbols, 

relationships, and, measurements. 
T(AQ) Theoretical Auditory Quantitative — ability, to 

fl n ^_ J?f? n JP9__'D teems of numerical symbols, 

relationships and measurements that are spoken. 



Meanings for qualitative symbols are derived from i three 
sources: 1) sensory stimuli; 2) cultural codes (games); and 3) 
programmatic effects of objects which convey an almost 
automatic impression of a definite series of images, scenes, 
events or operations: At the present time, there are 20 
qualitative symbols included in the "symbolic" set; five of 
them associated with sensory stimuli, five that are 
programmatic in nature, and ten associated with cultural 
codes. 



The five qualitative symbols associated with sensory 
stimuli are: 



Q(A) 



Q(O) 



Q(S) 



Q(T> 



Q(V) 
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Qualitative Auditory — _^biUty to P? rc ?' v ? 

meaning through the sense of hearing. A major in 
this area indicates ability to distinguish between 
sounds, tones of music, and other purely sonic 
sensations. 

Qualitative Olfactory — ability to perceive 
meaning through the sense i of smell; 
Qualitative Savory — ability to perceive meaning 
by the sense of taste. Chefs should have highly 
developed qualitative olfactory and savory 
abilities. 

Qualitative Tactile — ability to perceive meaning 

by the sense bftotjch, temperature, arid pain. 

Qualitative Visual — ability to perceive meaning 
through sight. 



. The qualitative symbols that are programmatic in 
nature are: ... .. _ 
Q(P) Qualitative Proprioceptive ~ ability to synthesize a 
number of symbolic mediations into a 
performance demanding monitoring of a complex 
task _ {e.g., playing S musical instrument, 
typewriting); or into an im medicate awareness of a 
Pdssibje set of interrelationships between sVmbolic 
mediations, i.e., dealing with "signs." 
Q(PD) QuaiHatlve Proprioceptive pexml - n 
predominance of right-eyed, right-handed and 
right-footed tendencies (a typically right-handed 
person) while synthesizing a_ number of symbolic 
mediations into a performance demanding 
monitoring of a complex task (e.g., playing a 
musical intrument, typewriting). 
Q(PK) Qualitative Proprioceptive Kinematics — ability to 
synthesize a riumberof symbolic mediations into a 
performance demanding the monitoring of a 
complex physical activity involving motion. 
Q(PSj Qualitative Proprioceptive Sinistral - a 
predominance . of left -eyed, left-handed and 
left-footed tendencies, {a typically, left-handed 
person) while synthesizing "a number, of symbolic 

mediations jhtd a performance demanding 

monitoring of a complex task (e.g., playing a 

musical instrument, typewriting). 

Q— PTM) Qualitative Proprioceptive Temporal - ability to 
synthesize a number of symbolic mediations into a 
performance demanding the monitoring of a 
complex physical activity involving timing. 

The remaining ten qualitative symbols associated with 
cultural codes are defined as: 

Q(CEM) Qualitative Code Em pathetic - sensitivity to the 
feelings of othors; ability to put yourself in 
another person's place and see things from his 
point of view. 

Q(CES) Qualitative Code Esthetic - ability to enjoy the 
be aut y of an object of an idea. Beauty in 
surroundings or a well-turned phrase are 
appreciated by a person possessing a major 
^h5ngth in this area. ._ 

Q(CET) Qualitative Code Ethic - commitment to a set of 
values, a group of principles, obligations and/or 
duties. 

Q(CH) Qualitative Code Histrionic _~ ability to exhibit a 
deliberate behavior, or play a role to produce 
some particular effect oh other persons. This 
type of person knows how to fulfill role 
expectations. ■ _ 

Q{CK) Qualitative Code Kineses ^ ability to 
understand; and to communicate by. 
non -linguistic functions such as facial expressions 
and motions of the body (e.g., smiles and 
gestures). 

Q(CKH) Qualitative Code Kinesthetic - ability to perform 
Inptb'' skills, or effect __musoi lar coordriation 
according to a recommended, or acceptable; form 
(e.g., bowling according to form, or golfing). 
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Q(CP) Qoaiitatitfe Code Proxemics - ability to judge 
the physical and social distance that the other 
person would permit, between oneself arid that 
other person. i_ 

Q(CS) , Qualitative Code Synnoetici - personal 
: knowledp-. of oneselL 

QiCtt / Qualitative Code Transartibrial — ability^ to 
maintain a positive communicative interaction 
which significantly Influences the goals of the 
persons involved in that interaction (e.g., 
salesmanship). 

Q(CTM) Qualitative Code temporal - ability to respond 
or behave abcbrdihg to >_ time __expecutions 
imposed on an activity by members Jn the 
role-set associated with that activity. 



Cultural Determinants 

There are_ three cultural determinants of the rneaning of 
symbols: 1) jfidividaality, 2) associates; and 3) family. It is 
through these ''determinants" that cultural influences are 
brought to bear by the individual oh the meanings of symbols 



Modalities of Inference 

The forms of inference the individual uses in the process of 
deriving meaning: 



M 



D 



F — Family 



i — Individual A — Mssbciates 



Magnitude - a fprm of "cajtegbriwl r«a«n thit 
utilizes norms or categorical classifications as the basis 
\fpr_ Accepting pr__rejectihj[ ah ^Yfhced hypothesis. 
Persons who need to define things In order to 
understand them reflect this modality. 
Difference — this pattern suggests a tehcJenj^ toj-eason 
in terms of one-to-one contrasts or comparisons, of 
selected - characteristics or measurements. Artists often 
possess this modality as do creative writers and 

musicians. _ _ _ ; 

Relationship — this modality indicates the ability to 
synthesize a number of dimensions or incidents into a 
unified meaning, or through analysis pi a__sity_atipji to. 
discover its component- parts. Psychiatrists frequently 
employ the modality of relationship in the process of 
psychoanalyzing a client. ; 

Appraisal — is the modality of inference employed by an 
individual who uses all three of the modalities noted 
|bpya_ W?»_pAirtd R), giving equal weight to each in his 
reasoning process, individuals who empioy this modality 
tend to analyze, question, or, m_ effect, .appraise that 
which i$ under consideration in the process of drawing a 
probability conclusion. -__>_ 
Deductive j^ irtf ic^s^e^yM^J*^^ 
of logical proof used in geometry or that employed in 
syllogistic reasoning. 



EDUCATIONAL COGNITIVE STYLE MAP 



SYMBOLIC 
ORIENTATIONS 
>»- . -v 
T(AL) 

T(AQ) 
TfVL) 
TWO) 
QfA) 
Q(0) 

msi 

QIT) 
Q(V) 
Q(P) 
Q(PK) 
Q(PTM) 
Q(CEM) 
O(CES) 
Q(OET) 
Q(CH) 
Q(CK) 
Q(CKH) 

eiep) 

Q(CS) 
Q{CT) 
Q{GTM) j 



CULTURAL 
DETERMINANTS 



MODALITIES OF 
INFERENCE 



MEMORY 



A 
F 



M 
D 
R 
L 



Presently 

Being 

Developed 



> 



ERIC 



38 



■r v' 



-31- 



_ Bp utilizing the techniques of observation, interview^ and 
preference testing, a diagnostician can gather and assemble data 
on the elements of each of the three major components of educational 
cognitive style to foot a profile, or "cognitive style map" ;of the 
.individual student. These elements may appear as major orientations 
( if the element score " occurs in the 50th-90th percentile of a dls- 
tribtrtion of scores for that element^ jainor orientations, denoted 
by a prime (if jfche element score occurs |n the 26th-49th percentile), 
or negligible orientations (if the element score is at or below the 
25th percexxtile)i 

Ttie testing procedure used to 'arrive at a co©aitive_ style map 
has received considerable discussion elsewhere (Radlke, 1973), and 
consequently a further detailed treatment seems inappropriate * 
Suffice it to say that the diagnostician may use any one, or all, 
of the three methods! (1) observation, (2) interview, and (3) pre- 
ference testing. 

The mapping of cognitive styles is mainly 
empirical in nature - 9 and as such^ is depend- 
ent upon the judgments of persons, (diag- 
nosticians) .o. Hie cognitive style of an 
o individual cannot be empirically mapped 
without considering s (l) the level of 
educational development of the person, 
(2) the general symbolic conditions of 
educational tasks he win be called upon 
to accomplish* (3) certain antecedents 
(e»g«* family) to his Resent state of 
development , and (4) the appropriateness 
of the elements under consideration for the 
conditions under which the educational tasks 
must be completed^ (H*JJ. 9 1970, p. 7) 

For those readers -teat are interested, Radike (1973) presents a ; 
valuable s u m ma r y -of the process of empirical mapping. 

Ike; educational cognitive style model is similar in some respects 
to the Task-Erbcess Jhtegcatibh Model (I^rtc&ard et ali i 1975) how- 
ever, it is content-free and considerably more global in its ,apprbach 
to student's learning style. Educational cognitive stjtte diagnosing 
can best be described as a combination of classroom and .clinical 
procedures and is clearly^ an ability training model although once 
the learner diagnosis is complete a farm of task-analysis is used 
in determining the symbolic orientation of instructional resources <, 
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The Model for jjlagnoslng ffithemablcal Deflclencles~(MD) 

r . . $ j j _ 

Siere has been _ considerable research focusing, on the traits of 
successful mathematics students (Shuart, 1970 ). The results, while 
ten ding to be inconclusive , do suggest ^at severol factors need to 
be given greater attention than the§- may jiave been given in^tfae pasts 
A partial list of -"identified" tr^ts, summarized from Shtaert (1970) f 
is found below* ^Kote that the totits^are. groped i roughly* as they 
relate to symbolic orientations 9 cultural dete rminan ts , and modalities 
of inference as found in educational cognitive style (Hill, 197ft 

The successful mathematics student 

has high general and reSective intelligence 
prefers objective, non-personal symbolism 
is high in verbal ability and comprehension 
is highly competitive 
possesses aul&c^tarian attitudes 

tends to be Insecure and sensitive 

tends to avoid social and interpersonal issues 

rates high on self-acceptance ^ ^ 

is anxious 

is concerned with "abstract" beliefs 

clings to convictions 

rejects imposed, standards of behavior 

prefers to act individually 

utilizes both analytical and ^ intuitive processes 

finds, organizes, afid evaluates relations 

has a fecdiity for syllogistic rewoning i. 

Bie abundance of factors that* must be_ considered in attempting to . 
provide each student with a successful mathematics experience point 
to the need for a comprehensive diagnostic model at the CllnloaJ 
level (tfaderhlU, 1976). ? ' 

* Some of the questions which must be attraded to^n the develop- 
ment of such. a model includej (ij what general information should 
be sought, (2) Wha^ mathematics content should be considered* (3) 
what sequence of concepts daouid be used* (ft) what levels of 
abstraction should be checked, (5) what sensory inputs should be 
examined, (6) what consideration should be given to af febtive aspects, 
(7) what consideration should be given to psychos-motor aspects, and 
* (8; what type of prescriptions should be available. These, and other 

related questions, form the focusing point for the development of the 
(Kp)2 clinical diagnostic model— A Bode! for Diagnosing jfethemattcal 
Deficiencies. 
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Jlhe model is a Itoee-fold model of _dtegnosis in that^the profile 
g en erated for an 1 nd Ividual Includes data relative tothafrt Indivi- 
dual' s unique mathematical deficiencies f 'to^emat^s s*^e^ rt and - 
educational cognitive style. This Information is gathered and -utilized 
during the course of an Intensive t analysis qf a student using case 
study techniques. The nine step process Involves i (J.) collection 
and analysis of entry information, content diagnosis In conjunction 
with f, mathematics style" diagnosis, (3) educational cognitive style - " 
diagnosis, {k) analysis fcf data st^s' 1^ ad^ 3 into a dlagnos- 
tic ^profilei [5) j^sppSMg of resource s, (6) prescription » (£J Implementa^ 
tion* (8) ev^uation; and,; if necessary (9) feedback into the diagnostic 
stenu ; , S . , - • ' _____ : " . ; ; 

- - - ^ - - - } Gbllecrbldh arid Analysis of _ntry Information 
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The^flnst ste p, the collection and analysis gf entry lnfoiMtion f 

is designed to provide general background data concerning the student* 
Some ^factors which are included here are parental information, school 
records , behavior patterns, interests, and anecdotal Information such 
as expressive ability, motivation, self-confidence, attentlveness, and 
attitude toward mathematics. Every effort should be made to secure 
reliable data from the student's classroom teacher, school officials, 
and parents. However, the diagnostician should also engage in the 
P^ 3 ^-^?"^? 1 ?. student with an eye not only toward the analysis, 

of mathematical abilities but also toward those behaviors reflecting 
the c&±id^_physicaij psychological ^ affective^ and social orienta- 
tions* Through an initial interview, as well as other means, the 
diagnostician should seek to identify such factors as interest! 
cooperative effort, persistence, flexibility, and adjustment to 
interview situations . The analysis of the student 9 s reaction to 
successes, failures, positive reinforcement and negative reinforce- 
ment may also provide clues to underlying content deficiencies. 

_ _ _' 2 - *-■ • 

Itof eojra^ to the (MD) model impUes jtt^ tte iMtl^t^ of the 

ref identi^e^ , 

or that the instigator simply wants some particular content area 
diagnosed* These , general content areas must be defined and recorded, 
before the (HB)2 model can be implemented* One aspect of this 
defining process is the interviewing of teachers and parents focus- 
ing on their Interpretation of what content should be diagnosed* 
This should then be followed up by an analysis of the student's 

standardized test resiiltsi If no such results are available the 

diagnosliciah may request or_conduct a standardized diagno jrfcic test 
such as the Bt^weii- Jdm^Btagttostic Test , V KeyMathi or th6 Stanf ordf 
Diagnostic Teat* This collection of data on the student's content 
deficiencies is most critical because the analysis of these results 
provides the means for determining where to begin in step twc* 

Prior to step two, the student's standardized test results are 
further analyzed In- order to form a prof lie of generalized mathe- 
matics deficiencies which is keyed to the Rent State tfaiverslty 
Mathematics &e ckitst ( 1975 )_in an^attempt to bracket these defi- 
ciencies with specific content statements . For example , it may be 
known that the student has some sort of difficulty with addition 
involving regrouping. The clinician then translates this information 
Into the relative sections of the Checklist, e.g., place value and 
addition, and selects appropriate entries which elaborate on the _- 
general difficulties, e.g., renaming numerals In several different 
waysj naming tira^sumof a_two-piace whole number and a one-place \ 
fthole nxrabe^ with single regrouping (ones to tens) , and naming the 
sum of a three-place whole number and a two-place whole number with 
two regroupings. Thus, the purpose at this point is to tentatively 
identify those elements of the mathematics checklist which will be 



used in step two of the model • (It should /be noted that the KSU 
GhecK±st^is a 30 page comprehensive checklist of mathematical 
concepts for grades K-8«) 

Step two represents one of the most critical components of the 
(MD) 2 model for It is at this stage that the specific mathematics 
deficiencies are isolated. This isolation process occurs through 
oral interview of the student centering on questions designed to 
translate checklist entries into specific tasks at the concrete 9 
representative, and abstract levels. 

ih con junction with the Identification of specif 1c mathematics 

deficiencies, the cKnician identifies the student's ^Mathematics 
style." Ihls refers to the observattcm' of the student's utilization 
of what are- referred to as •^response modes" and Response formats" 
in reaction to various "presentation farmatso" 

— a __ _ __' i 

Ttie (MD) model utilizes the following operational definitions 
for "presentation formats" and Response modes and formats. " 

^esentation f annate can b^iitontified as the f ollowingi 
Auditory (A) i toose questions which are posed solely throu^i ora2^ 

means. ihe student is asked to respond to that which is heard. 
Visual (V)i those questions which are posed solely through visual 

means. The student is asked to respond to that which Is seen. 
Aiiditc^r Visual (A-y)i those questions which are posed through "both 

oral and visual means. Ihe student is asked to respond to that 

which Is heard and seen, 
Pbrcei Response* the student must use a given response mode. 

Open^esponsej the student may select a response mode. , 

Generative t those questions which call for the student to generate 

the correct response. 
Non-generative i those questions which call for the student to select 

the correct response £rom a given set of responses. 

Response Formats and Modes can be identified as the following r 
Oral Concrete (0C)i the student responds to a given question by 

cerally des^Lhing the situation in terms of concrete objects. 
Oral Representative (0R)t the student responds to _a_ given question 

by orally describing the situation in terms of "*a model or %~ 

pictorial representation of concrete objects. 
Oral Abstract (0Ab)$ the student responds tjrf a given question by 

orally describing the situation in terms of abstract symbols. 
Graphic Concrete (GC)i the student responds to a given question by 

describing, in graphic form, the situation in terms of concrete 

objects. / ^ ^ 

Graphic Representative (GR)t .the student responds to a given ques- 

tion by describing, in graphic form, the situation in terms of 

a model or pictorial representation of concrete objects. 
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the student responds to a 

form 9 the situation In terms of 



Graphic Abstract (GAb)i 
by describing, in 

abstract symbols* 

Manipulative Concrete (MC) s the student responds to a 
tion by manipulating concrete objects to describe 



given ques- 
the situation 



There are several response modes which involve combinations of 
the aforementioned! "unary" response modes. These are i 
Oral-graphic Concrete ( O-GC) s the student responds to a given 

question by describing, both orally and in graphic form, the 
Z _ situation in tprms of concrete objects. 
QralrGraphic Representative (O-GR)i the student responds to a 

given question by describing, both orally and in graphic form, 
the situation in terms of a model or pictorial r epre sentatio ns 
of concrete objects^ 

Oral-Graphic Abstract (OGAb)i the student responds to a given 

question by describing, both orally and in graphic form^ the 
situation in terms of abstract symbols, 
Oral-Manipulative Concrete ( O-MC) % the student responds to a given 
question by describing,, both orally and by manipulation, the 
situation^ in terms of -concrete objects. 
Graphic-Manipulative ! Concrete (G-MC) i the student responds to a 
given question "by describing, both^in grapMc f qrm and Jty . 

maripulstion* -Hie situation in terms of concrete objects. 

Qral-Graphic-Manipulative Concrete (O-G-MC): the student responds 
° to a jgiven question lay describing i in araiand gp^phic f orm 
and by manipulation, the situation ih terms of concrete objects 



Graphically, the (MD) mathematics style model is shown below 



Presentation A -Y/^ 
Formats 



lf Mathema tics Style" 
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Bie prwious plate graphically represents the mathematics style 
component of the (MD) 2 model. Note that In a diagnostic session 9 
the trained clinician will use subjective Judgment In the selection 
of which cells to diagnose. For a given checklist entry certain 

Sells are l^pprc^«rt-ate and still others pan he eliminated on a 

selective basis 0 Thus, for a given checklist entry -toe diagnostician 
may ask questions based on from one. to, say, four ceils of -Use model. 



As the content diagnosis progresses the clinician needs to 
record * In some detail, the events which are (or may be) relevant 
to Identifying the student's deficiencies. . The figure below 
represents one method of recording the presentation format and 
response mode and format for each major question. It should be ' 
noted that the figure has been reduced in size. 



A-V 



fr-'G 



M 



0-M 



G-M O-G-H 



Cells are filled with either Ab, R, or G 
followed by a humeral indicating the order 
in which the question was asked. 

Clearly , the information recorded on this form is invaluable 
for profiling a student's ma^ 

provide information relative to specific questions asked nor does 
it make record of aay^ exta^^ous ftotors which may affect student 
response. The Interview Becord sheet indicates that the clinician 
should record the nugber of the question being asked. Since all 
of the questions cannot be determined in advance—they will depend 
on student responses to previous questions—some method of record- 
ing questions is needed. Far this reason it is strongly suggested 

that the_ interview be audlp^taiied and, if possible . videotaped. 

This will allow the wiifHwiAi to reconstruct the session for purposes 
of further analysis. 

J Whra step two of the _(8B) 2 iodel^is completed the clinician 
should have a relatively clear picture of the student's mathematical 
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strengths and. Keaknesses as well as an underst anding of the stu dent's 
••mathematics style^" Consequents 9 it would be possible to terminate 
the diagnosis at this point and prescribe corrective teaching based 
on these findings. However, the (MD) 2 model has an additional com- 
ponent which enhances the possibility for successful prescriptions-- 
the diagnosis of general educational cognitive style 0 

Step tteee , the edu*»ttonal cog^tiye style component of the (MD)^ 

modei^is based im a^ abbreviated version of the model proposed by 
the ite^rtcam Bducationai Science Association, The clinician should^ 
gather, cognitive style data through observation and Int er vi ew whenever 
possible, however there is a preference test which can be used either 
solely or in conjunction with the other two methods, 

__ Following the observation, interview, and preference testing 
of the individual to gather data on educational cognitive style the 
clinician is prepared to initiai^si^ J our of tte (MD) 2 model 0 
This step represents -toe stage during wh±^_ the data collected in 
steps one, two^ and three Is analyzed into a student d i agn ostic 
profile • This profile Includes data pert aining to t (l) general 
information reflecting student background, (2) the student 1 s specific 
mathematics deficiencies and mathematics style, and (3) the student's 
educational cognitive style* The clinician's task is to piece to- 
gether this information to form a profile representing the diagnosis 
of the individual. - . f : \ ^ 

One aspect of stage four is toe search f br corais'tonqyjbetween 

the student • s marttiematics style and educatioMtl cog^tive style, A 

given student may , du r ing the^content diagnosis, exhibit a tendency 
to react positively to questions presented in a visual 'format but 
negatively to those with an auditbry format § If this same student's 
educational cognitive >style map indicates & minor or negligible 
T(VL), T(VQ), or' Q(V) element then the diagnbsis^may be incomplete-^- 
at the least, it must be reviewed for errors. If, 6x1 the other hand, 

the findings from the mathematics style diagnosis and the findings 

from the educational c ognitive style diagnosis m^chthen the clinician 
can be reas onably certain that steps two and three of the (MD) 2 model 
were successful. 



An additional element of consistency can be checked at this 1 
stage of the diagnostic process. It is possible to describe a 
cognitive style map which indicates the ability to deal with mathe- 
matics presented at the concrete, representative, and abstract levels, 
teing_the Information pr ovi ded by su oh maps the clinician is able to 
determine whether an individuals ina b ili ty to successfully deal with 
mathematics presented at a. particular level of abstraction is caused 
by a deficiency In certain cognitive style components or by a lack 
of experience with a given level of abstraction, Ciat is to say, if 
an individual's map indicates the presence of those components 



~; -46 

ERIC 



necessary for working at the concrete level but the mathematics style 
aspect of the content diagnosis suggests that the student has dif- 
ficulty describing or completing exercises at this level then, perhaps 
the student has not had sufficient experiences with concrete models. 
The concept of division serves as an excellent example of the impor- 
tance of tirts step of ^ the analysis done by the clinician. Consiiier 

a student that can complete the division algorithm but csxmqt use 
counters to ii^tstrate the process. Is it because the student is 
incapable of modeling (because of a lade of cognitive style components) 
or is it because the student has never had to model the operation and 
therefore lacks, understanding and experience? Hie question poses 
interesting problems in designing corrective procedures. 

__ _ g _ _ ___ 

. Step five qf_ the (MD) , model represents the first step in the 

. process of prescription development. Diagnosis based on cognitive 
style constructs will be of little value prescribed acttvities 

do not provide a high _proteMi±1y o^student success* BwTefare^ 

the diagnostician must not only diagnose the studezrbf but also those 
tasks which may be used in- subsequent instruction (HUl f 19 In 
this manner cognitive style diagnosis hot only provides the 
identification of the unique structures each individual brings to a 
learning situation, but it also allows for the 1a»Mlatibh of this 
uniqueness Into proposed programs of instruction (Badike, 1973 )• 



In step five, the clinician maps the Instructional* resources — 
the purpose being to determine the _cognitiye style conditions of 
those aspects of the educational enviroment i^ch may b^ i» for 
corrective teaching* Included in this category 9 and therefore, sub ject 
to mapping, are persons (those individual's that may play a role In 
the subsequent teaching of the child, e.g., teacher * tutor , librarian, 
and counselor) 9 processes (those activities which may be used in 
subsequent teaching, e.g. , methods of Instruction), and properties 

(materials used In subsequent teaching, e.g of audio-tapes L films, 

books, workshe ets, and ma^puiatives). Generally speaking, diagnosis 

of properties pr ovides data for the matching of symbolic orientations , 
diagnosis of processes provides data far matching modalities of 
inference, and diagnosis of persons provides data far matching cul- 
tural determinants.' It should be noted, however, that these three 
components of cognitive style must be considered as inseparable and 
consequently heed to be viewed as a totality. 

The mapping process at -Hals stage Is the same as "it was for _ 

step thrse. The ciiniretgTT must map the instructional resources in 

the same manner as mapping the student who will come Into contact 
with these resources. That ie ; the symbolic conditions of elements 
of the instructional process are determined so that Individuals can 
be matched to these for prescriptive purposes. As an example, assume 
a possible corrective teaching technique Involves having the child 
work with a peer on the analysis of ward, problems according to certain 
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delineated procgdares~a fixed step-bjr-step approach* The ciinician 
mapping such a task may arriv e at the following condition of this 
tasko 




For the child whose map is shown below this nay- not be a valuable 
experience o ° 




That is, the interface between the conditions of the task and the 
cognitive style of the student do not sufficiently match; 

It should be not ed that, theoretically at leasts step five 
may only have to be completed once* if the clinician, or the 
teacher, maps all of the resources available then these same maps 
can be filed, far use in the development of prescriptions far several 
s indents. Therefore, a goal of the clinician should be the compila- 
tion of resource maps far quick reference in future situations. 

, g , 

_Step six of the (MD) model Involves the preparation of pre- 
scriptions and, of course, these prescripttora are based on the 
information gleaned from steps one through five. Cognizance of 
individual differences is no less critical at this stage than it 
is at any other stage, of the (HE) 2 odel* The purpose of the_ 
prescription is to relate the indiv- rl 9 s unique (MD) 2 profile 
to the available resources- in a mannex ^hich will provide the " 
greatest "probability of success* Some possible prescariptive, routes 
based on cognitive style diagnosis of both individuals azxd educa- 
tional tasks are presented in the' following table. 
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Personalizing Education (Adapted froa Bowman, Birch, Hill, fc Nunney, 1974) 
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Ebe format of the presraip-tton may vary but there are certain 
characteristics which each prescription should include* Oxe criteria 
is comprehensiveness. She prescription should Include a synopsis 
of _*11 <3ata obtained, in steps one through _f ive wganiged and pre- 
sented In a manner which clearly Conveys the clinicians analysis and 
interpretation of the data. Any formal and/or Informal tests which 
were administered during the course of the diagnosis should be 
described *d&g with student reactions to tiiese tests* Steh major 
component of the (ffl>)2 model, i.e., content diagnosis, mathematics 
style j and educational costive jrt^e, must be discussed in great 
detail. Each component could be mentioned in isolation, however, 
because of their inteeerelatedness §_ a concurrent discussion designed 
at weaSvlng thf three into one overall picture is preferred* Separate 
ttscussions of the components does , however § have 'the' advantage of 
providing the teacher with a clear-cut picture of each* Also, : 
becansg ofr -fee _strcng relationship betweeg mathematics style aad 
educational cognitiw style it may be desirable to present a cogent 
discussion of these two components and a separate discussion of 
specific conte^deficienciesi ^Nevertheless, this should still be / 
fallowed ly a synthesis of aiithree as a -hedge against the teacher 
basing corrective teaching on the content diagnosis alone « The 
xteacher must not overlook the prescriptive benefits gained from the 
model's ability to diagnose the student's ca^biiities to the^reas 
of\ symbolic orientations, modalities of inference* and large group, 
small group, and independent study. 



^e final pointy on prescription deserves~indeed demands--- ■ 
attention* Any diagnosis will indicate to the clinician certain 
strengths and weaknesses which will necessarily affect the design 
of corrective teaching prbcednres--the question is "Hbw ,, ? The 
clinician j^as two alternatives to pursue. 

On the bne hand, a prescription ckn be written which calls for 

corrective teaming ^te^nigues designed to utilize, s1a*engths in both 
mathematics sty|e and cogirttive s-^le to build skill and understand- 
ing with those areas identified as content^ deficiencies, for the most 
part ignoring style weaknesses in _the ^instructional design. Par ex-_ 
le, consider ^e, student with the following over-simplified profile < 

Content Defici^ey , 

fractions in simplest form 
fractional numbers - 
Mathematical style 

oriented 
tees concrete objects 
Educational Cognitive Style' 

AL) TM 

a} \ y t 




1 
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IMder the above philosophy of corrective teaching this student, may _ 
be asked to sit alone at a listening station with audio tapes Keyed 
to cards with appropriate numerals on them. These tapes describe 
the process of ^renanlng f^stlms In simplest fcsrm "by way of using 
concrete objects directs -toe ditid to model fractions using 
cutsenalre rods placed at the stations Little or no ref eren ce 
would be made to visually-oriented resources , e.g., filmstripsi 
nor would any concerted effort be made to have the studeirt work with 
peers or watch the teacher model some examples at the board. 

The other alternative position on corrective teaching is to 

utilize both strengths and weaknesses in mathematics style and 
cognitive style in order to eliminate content deficiencies.. For 
the example just given the^ prescription would include such ^activi- 
ties as peer assistance , visual aids , teacher demonstration, etc. 
The rationale for using slyle weaknesses is that through use they 
may develop Into strengths. 

On the surface it seems as though the second alternative would 
be most beneficial. In' fact. In most instances it would be the 
most probable route for eliminating deficiencies. After all > It 
does provide the student wltlh a greater varied of opportunities 
to identify errors and iaisconceptioni. However , this does not mean 
that tjhis philosopher of cqrrecttve xeacddng will work best £ar all. 

jhg ae Students with serious content deficiencies may become erven ;_■ _ 

more confused' by having to deal with two deficiencies at once, namely 

content deficiencies and style deficiencies. I 

I ■ 

lb summarize 9 prescriptions call trig fcr_cbocre<rtive^ 
demand careful consideration. At the risk of <xver^simpllfying 9 
students with major content deficiencies should receive corrective 
instruction designed Jra ut iii z^jbheto-*rfole strengths to jia^eviate_^ 
these deflciencd es^^ jriyjle students with minor content deficiencies 
should receive corrective in s t r uc tion designed to utilize their I _ 
style strengths and weaknesses to alleviate their deficiencies, J ■* 
The determination of what are major or minor content, deficiencies 
should be based on analysis of test results and the subjective I 
judgment of a trained clinician. ' J • / 

- 2 ' - '■- ' ' -I •■' '-J' 
Step seven of the (OT) m<^^ 

means of inc o r po rating the results of the entire diagnostic process 
into the instructional pr og r am . This is\got to be coniftosed wl^ 
the act of corrective tea min g which is not a part of /the model 1 j_ 
since it is an activity carried out by the classroom, teacher. The 
implementation of the (MD) 2 model refers to the manner -In which 
the diagnosis Is transmitted to the teacher. The vehicle for 
accomplishing this step is the _ 63 1 nlclan-teacher conference . Th/e 
prescription report discussed In step six may simply /be delivered • 
to the teacher for consideration, however, it Is strongly suggested 
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that a conference "be arranged so that the possibilities of misinter- 
pretation are lessened prior to the Initiation of corrective teaching 
procedures, When, both parties have come to a, consensus concerning 
the findings of the diagnosis and the purpose and rationale of the 
prescription the teacher may then determine the manner in which 
instruction will take place. 

Evaluation, step eighty is "based primarily teadfeer^inpirb 
^*?^_^ 0 ??®?^?®_'^? a ^l?? has "begun » once again through clinician- 
teacher conferences. B*e teacher input should be founded on observa- 
tions and test results. _ An additional aspect of the-, evaluation step 
is observation, the clinician, of the child, at wgrk lit the class- 
room. Observation 'by "both the clinician and the, teacher is designed 
to allow for a "comparing of notes" (which may assist the development 
of greater iriterrater reliability for later referals) and to form a 
common base of knowledge concerning the student's status to insure 
the success of the clinician-teacher conference. 

Feedback into the dia^ortic ^rstemi step nine i may be the 
result of step eighty the ciiniciaa-teacher conference* She re-entry 
step will, vary for individual students. , Far some it may be necessary 
to begin the entire diagnostic process anew. ' Jjpr others, re-entry 
may take place at either step two (content diagnoses incorporating 
mathematics style), step three (educational cognitive style diagnosis), 
step four (analysis of steps one, two, or three), or step six (pre- 
scrlptlon writing). \ . \ 

Hius, the diagnostic process has traveled full circle. If 
camied o^pr^^^r there should be a^wealtb of " Information, avail- 
able ^concerning not only what the student does and does not know 
but also concerning the manner In which the student does and does 
hot take on meaning* Hie real value, however, is not in simply 

having this information but in uslng v it. A carefully planned 

follow-up program of corrective teaching is critical to the success 
of any diagnostic .venture. / ■ 

ommendatlons for Further Study \. 



3y way of conclusion it seems appropriate to review some of J 
the more pertinent aspects of tho model. First, it is essential 
that the reader understand the clinical nature of the model. It 
is designed 'to describe a possible diagnostic process which can be 

carried out 1jy_ a trained clinician--it m^ have some value in ^ 

classroom diagnosis brat this fs not the Intended target. Second, 
it is Im p ortan t to note that this model is notintended to be used 
only wtUh those students that have severe mathematics difficulties. 
The mathematics style and educational cognitive style components 
of' the model make this model valuable for the diagnosis of any 
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studeht of mathematics • Ihted* m the acl^^ diagnosis of an 
Individual^ mathematics style «Uts joo? intended pat aii_ ttbirty- 
nine cells be tested* It is necessary for the clinician to use 
subjective judgment aifd select those cells wftic* are most ap pr op r ia te 
for the task at hand* Fburth, the £mE)2 models when implemented, 
does not describe a diagnostic test £*om which one teaches. There 
must be intermediate steps between th^ administration of this model 
and the actual instructional process* 

Ifce Model &ac Diagnosing MB^OTa^Lteai deficiencies is presented 
as one conceptualization of the manner to which diagnoeds jsould 
proceed* Sie evidence on inte«elati6n^ips among the abundance 
of factors affecting development suggests\ that each student brings 
to each 'learning situation a differential combination of unlq.ua 
capabilities and abilities,, each at a particular stage of develop-* 
^ment o Diagnosis , then t should strive to describe ; these capabilities 
and abilities and the factors which affect them* Its ultimate * 
purposei is to ^feci^Ltate the extraction off individual 1 ,zefc ps?e^ 
scrlptions^for uniqug ly ^ organ ized persons* The (MD) 2 model represents 
one attempt to reach this goal* 

The pu^bse of this paper wets to develop and describe^, finical 
model for diagnosing mathematical deficiencies which incorporates 
cognitive, affective, and psychomotor aspects of educational cognitive 
sjyle* lhis model is designed in such a way as to reflect consistency 
with the flew that the jbask of diagnosis is to describe a $erobjaallty 
as w^il as a person's subject matter deficiencies* 

j_ ft is i^ortant tojiote th^ ^e p^^se of this paper was not 
to describe processes through which the diagnostic model could be ' V 
Implemented* Indeed, application concerns are not (nor, atoo^d they 
be), factors in the design stage of model development* Hypothesiz- 
ing; on possible application difficulties prior to the development 
of a model may cause undue restrictions and limitations to fate 
in the mind of the ie&igtier/ Comments relevant to this point can 
be found throughout the literature* Fbr example, * 

A ba^JLc innovative design* may well be •useless" 
in the sense that it has little or no appili^ 
tion Immediately to schools as educational 
institutions.*. • Concern for -the immediate 
applicability of the findings can distract the 
researcher, narrow his efforts and hasien him 
to unjustified conclusions. (Brlckell, I96I, 
P* 82) / 

• \.' ' 

Thus* Brlckell described three distinguishable phases of ^ 
innovation t design, evaluation, and demonstration! and their ideal 
settings which are, respectively 1 freedom, control, and normality* 



.» r ■ 
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Werner (1968), in commenting on BrickellTs notion of -three 
phases of innovation, stated 

_ _ \ ___ -J _ ; '_ __\_ 

Bisign efforts cannot "be conducted/% evaluation 
settings because experimental conteois of \the 
igrpe needed far adequate^ evaluation kre re^tric- 
l^ej^ toeiar very nature* ffiese restrictions 
reduce the freedom to explore for somel 
better* Sie ordinary ^ uheirriched setting needed 
for the demonstration of a proven innovation is 
the setting least likely to generate new designs 0 
Hie observer of a demonstration needs to see the 
demonstration of the Innovation as part of the \ \ 
normal, ongoing program in^a school like his own. 
For these reasons^ theref ore^ the cir&^tances \ 
needed for the design of an Innovation cannot be 
reconciled with those needed far proper evalua- 
tion and demonstration of the Itineration* 
(Werner, 1968, pp. 89-90) 



A similar concern was expressed by Wilson (1973) in a paper railing 
far more efforts inoperative re sear ch~spe 

vention research. Citing the unfortunate tendency to ervaluate the 
results degenerative research on the basis of aritterla designed 
for confirmative e3^pertment^ researcdip Wilson noie£^ that "clinical 
Intervention is either not recognized as researc^r^or is depreciated 
as research^ and in some circles even deprecated" as research" (Wilson, 
1973. PP. 



As_ previously mentioned, Etigelhardt ,£197^ ha^ commented on the 

difficulties encountered in expOTlmentai'reseaa:^ without the benefit 
of a theoretical model, lhus the significance Ipf this paper Hes in 
its ^purpose, tftat 1b, it Is the development of £ thedretlcsal. model* _ 
and a description of Its accompanying ixxstrtaaen-^tion, for clinically 
diagnosing mat&OTaticai deficienciesVahd its relation tQ the teaching 
and to the learning of mathematics. V I 

Ehus* at the risk of "d^^d»(^tl<m ,, car ,, deprecat^on, ,, the present 
paper Is best described as a generativeXeffort feb describe a diag- 
nostic model far clinical use In identiftring^n! indlvidioal^s unique 
mathematics deficiencies. It should be racognteei as a first attem]pfc 
which has, at this point, only been administered on a limited basltf. 
Nbir, and- only now, it needs to be examtaedi\andj possibly adapted, 
for use in diagnostic-prescriptive settings « 



Because this study is jhot based cm statistical analysis con- 
clusion^ s imilar to those found in experimentaOly-ariented studies 

cannot 'be stated. Consequently, this section ls\devoid of any 

attempt to state inferences but instead focuses on areas of further 
study and needed research. / \ 
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The design. process used In the development of the (MD) model 
suggests the following areas of needed research and development. 

1. The (MD) model suggei3ts a hierarchical checklist for use 
in determining a student • s content deficiencies. This 
hierarchy is based op expert judgment hut perhaps other * 
means of hierarchy validation such as Guttman analysis 
should he attempted.' 

~~ - " ~ 2 ' -1- - ■ — '■ 

2. The (MD) model suggests the use of a standardised diagnos 

tic test to obtain /entry level information on the child's 
content deficiencies. Does a standardized diagnostic 
test provide sufficient data for transferring general 

difficulty areas into the checklist? 

1 ■ -tf 



3* The 



2 /- — 

model suggests instrumentation to be used in 



conjunction with /a checklist for diagnosing a student's : 
mathematical style 0 A next step would be the development 
of a battery of /items for each entry in the checklist 0 

Several questions would heed attention t 



Should the development of this battery begin with 
one or two concept clusters or should the entire 
checklist be sub ject to item developaent ? ( This 
question becomes critical irtien one realizes that 
the checklist is not sequenced across concepts • ) 



(b)^ How many items are needed far -each entry of the 
, checklist? (It is necessary to consider the pos- 
\ sibxe presentation and response formats for an 

individual entry before this question can be 

answered. ) 

(c) 



i ■ 



icemlng the internal structure of the item 
kery, shouM^toe questions be dpen , or f arced 

r&sjponse? Generative or nc ^-generative response? 

3uld there be a mixture of these response types? 
i j . _ _2 

Considering implemention of the (MD) model in diagnostic 



prescriptive setti 



1. 



The (MD) 
lmpiemen* 
What proo 
clinicians 
classroom 
capabllitl 



le following areas need to be inspected. 

3l f while not so complicated that It can't be 
loss require a certain amount of expertise □ 
as must be developed for training mathematics 
the^use of the (MD)* model? For tr aining _\ 
ichers in its use? In*what ways can computer 
be used to simplify the data collection and 



record keeping aspects of the (MD) 2 model? 



/ 
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2. .The (MD) model Is designed far use In a mathematics clinic i 
far at least in a program Kith clinical procedures. Several 1 
/authors have suggested that the adaptation of clinical 
practices to classroom techniques is beneficial (Buswell, 
. 1935; Callahan, 1973; Denmark, 197 2 *). What L adaptation is 
necessary before (MD) 2 can "be usfed in classroom diagnosis? 

2 

3i The educational cognitive style component of the (MB) model 
has been successfully used at the upper elementary , secondary, 
and college levels* The (MD) 2 model itself is designed for 
use at any level _ of mathematics _ instruction , however the 
vehicle used to describe the model is elementary school 
mathematics. What changes, if any, are needed in the model 
design before it can be Implemented at the secondary, and 
post-secondary levels? 

b 0 It has been suggested that Ign^tndtml study is needed to 
detemtae- the usefulness of cognitive style diagnosis 
(Sternberg, 1975 )• Ihus, a long-range testing program may 
need to be established bef ocpe. the value of a model such as 
(MB) 2 can be fully evaluatedo 

Asstmirig that implementation attempts are successful, certain 
questions on the actual use of the (MD) 2 model need to be addressed* 

3hess included 

p • — 

lo The (MD) model is designed to provide an individual prof lie 
of three major areas:, content deficiencies, mathematics 
style, and educational cognitive style • Is there benefit 
to be gained by fractionating the\model and using only one 
of the component's? Any tiro of the components? 

2. The (MD) 2 diagnostic model assumes t^rt, among other methods, 
a dyadic interview wi ll be use d to gather data« If a stu- 
dent does not perform appropriately on a\dlagnostic instrument 
it may be due to other factors aside £rc^ hot 
understanding the concept being assessed. What critical 
factors can be identified that affect clinician-student 
interactions? What role does clinician cognitive style 
play in determining the success of the interview? xls 
there a 'ftost effective" clinician cognitive style ? x \ 



3q Ihe (MP) model is designed to describe individuals ftoaV 
a variety^ of perspectives* What are the individual dif- 
ference variables which might affect performance in the 
diagnostic setting that have hbt_ been considered? How 
does use of the model affect children?, Are cognitive 
ctyles of Individuals content specific? 
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2 

4. She (MS) model provides the opportunity to use diagnosed 
strengths and weaknesses in a variety of ways . Does 
remediation based on using cognitive style strengths to ' 
eliminate content deficiencies prove to be more successful 
than using a combination which stresses strengths but also 
attempts to eliminate weaknesses "through use? 

She above represent questions generated _fcdm the deveio^ent of 
the, Cli n ica l Model :*or Diagnosing fethematical Deficiencies— ( MD ) 2 i 
Since this paper is concerned with only the design stage of model 
development it is clear that a significant amount of work must be 
done before implementation 0 This work how begins. 
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Reaction Paper 

to 

A Clinical Model for Diagnosing Mathematical 
Deficiencies incorporating Educational Cognitive Style 



Lelon R. Capps 
University of Kansas 



this paper is brief for two reasons. Firsts the description of 
the model is indeed complete and comprehensive. Second* _ much of the 
information needed for revision, and reaction can be forthcoming only 

as the model is implemented. The last six pages of the paper pre- 

seated by Dr. Speer put line, many of the unanswered questions concerning 
the application of the model and deserve the careful attention of any- 
one involved in using the model. 

One must note that the model relies heavily on subjective inter- 
pretation of verbal description. Thus,- some specific training is 
necessary to gain consistency in descriptors of the behavior. Also, 
in some instances there may be the possibility of gathering similar 
data with more objective checklists. 

In attempting to describe educational cognitive style the search 
must be for some pattern of consistency. It is on this component of 
the model where the greatest care must be exercised in interpreting 
the information gathered in the process. To predict behavior of this 
nature with consistency is indeed a difficult task. 

__>._ s 

While educational cognitive style is content free* it is not 
culture free. Perhaps some future research should deal with the role 
of cultural background and its effect on cognitive style. Stodolsky 
and Lesser (1957) suggest the nature of this relationship in their 
studies. 

In gathering information about content deficiencies using the 
standardized tests may be of only limited value. It should be Viewed 

only as a broad screening devices As indicated in the. paper j one 

needs a much more comprehensive set of descriptors such as those 
included in the Kent State University Mathematics Checklist. 

It should be. pointed but that current practice among educators 
usually goes billy through. step two of this model. _It is step three of 
this model that makes it intriguing and appealing to the researcher^- ^ 
and teacher interested in diagnost^ 

In _step-four7of Ttfie^rodel one wonders if a learner will exhibit 
the same profile across content areas and across diagnosticians. This 
will need to' be cieariy demonstrated by careful collection of data 
when the model is implemented. 
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In step six of the model, the diagnosticians tnust not be misled 
into. thinking. that there is one best prescription. In practice the 
model will allow for a variation of prescription. Of basic interest 
should be a study of the relationship of the profile to the prescrip- 
tion and the success of the prescription i fh e _* eact:or suggests that 
careful research should be conducted to study this relationship. 

A major concern 15]l^i^e5FS^^he~prescriptioh centers -on who 
does the prescriptive instruction. If the diagnostician does the 
corrective instruction * the probability tor success will be greater. 
If the classroom teacher is A to do the corrective teaching, there is 
a definite risk of losing much or the information gathered on the ' 
prof ile as it relates to the instructional process, for this reason* 
transmitting the information to a classroom teacher is ^critical step 
in the process and if not well done> could result in very limited 
success. Hopefully, the model will be of value to the classroom 
teacher even though it is a clinical model. Perhaps , the model will 
^ e °^ most value only if the classroom teacher can interpret the 
results and implement the corrective instruction successfully. 

In the end, the model also must be of value in identifying and 

perhaps modifying the educational cognitive style of the teacher. j That 
is, weakness in instructional strategies being employed by a teacher can 
be identified and, if modified appropriately, there will be a reduction 
in the number of students with mathematical deficiencies in the teacher's 
classes. 

In summary, the model presents an initial and hopeful step in the 
area of diagnosis and prescription. Dr. Speer has done a commendable 
piece of work though there is much yet to be -ddne^ The model makes no 
claims to be an instrument of an exact science. To the contrary, it 
is a map which shows the _rbitte to follow but does not guarantee the 
condition of the rbad ; . The judgment of the user and the ability to 
remain flexible no doubt will be two crucial variables, in determining 
the condition of the road. 
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Feedback in Diagnostic testing 

Jon M. Engelhardt 
Arizona State University 

In the testing situation, telling students whether or not theiiv 

answers are correct * s _comiBonly prohibited ot delayed until students 
have responded to^aii the items (e.g., Anastasi, 1976; Cronbach,^196b) . 
Although it is sometimes suggested that testers insert perfunctory 
comments like "Good" or "Fine*" tHis is done only to encourage the \ 
students by acknowledging effort, not to indicate success on a par- 
ticular item. The primaiy rationale for withholding such correctness 
feedback is to "standardize 11 testing conditions, i.e.^ to effectively 
control the variance attributable to all factors in the test situation 
except the factor being measured. Such control is usually established 
by creating uniform testing conditions. In this way potentially con- 
founding factors are either eliminated, or their effect upon the vari- 
ance is roughly equalized "for all subjects; hence, any differences among 
individuals 1 test scores are the result of dttferercra i^ the factor 
being measured. Thus, feedback on response correctness is thought to be 
controlled through a uniform system of non-feedback from— the- tester- 

This writer's several years in 



a diagnostic/presc 
mathematics clinic has led to questioning this procedur^ in diagnostic 
3ittia i4 dtis > particularly situations involving indi]7idually admin- 
istered tests. During diagnostic testing in 'the clinic^ it has often 
seemed obvious that some students made conclusions about whether or not 
their answers were correct, even though no clues were given by the 

testers. When testers did acc ide ntally give feedback, students^ facial 

expressions of disbelief and comments like "I knew it" furth^-re±fiF^" 
forced this observation'. If the purpose of ^i^h^diug^correctaess 
feedback_is to ^provide uniform studen4^-ignorance of response correctness 
or a uniform Effect from ^such"^feedback, then this procedure seems to 
have^fajU.ed^^ some, if not all, 

-students seem to substitute their own idiosyncratic systems of feedback. 



^?PP9?? f ° r this observation can be found in .both theoretical , 
formulations and limited research finding? •_ Annnons (1956) , in reviewing 
the research literature on knowledge of performance, proposed that there 
is always some knowledge of performance available to the human performer i 
ranging from the intrinsic feedback of the senses or an n it feels right 11 
feeling to the extrinsic feedback of evaluative comments like "you are 
doing well." Stated in other words* Annett (1969) 3 indicated that when 
extrinsic feedback such as accuracy scores is withheld, most aspects of 
some intrinsic feedbadk system remain intact. Smith and Smith (1966), 
FPP^Zi-^S ^his idea more to the usual learning scene, stated that as 

a ?_ *?**Y**??I : 1 ? _^9^y _ ^?°^i?^S^ ??°^ s » _ ?^ e _ ^d^iduat tab lishes 
intrinsic standards of accuracy, logic and consistency against which to 

* ■ 
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monitor his responses; thus extrinsic signals like "That's right!" or 
"Correct!" may serve only to confirm the individual's intrinsic moni- 



toring . 



Several research studies have also suggested students 9 use of 
\ subjective feedback^ Arps (1917; 1920), in a study of individuals in a 
V finger weight lifting task, found that when experimenter feedback on 
\ performance was discontinued, some performers reported imagining pen 
'marks and the physical characteristics of each lift to help maintain 
their performance. Book and Norvelle (1922) studied children performing 
simple tasks like writing n a f s" as rapidly as possible; when the chil- 
dren were no longer given feedback on their performance, many children 
were reported to have developed methods of judging how well they did. 
When Itoss (1927) found no difference in performance between college 
students receiving quiz feedback and students not receiving; feedback, he 
reanalyzed the situation and found the no-feedback students guessed 
their quiz scores quite well; presumably they j received some sort of 
subjective feedback. In a study of students 1 / confidence in judging 
whether word pairs were synonyms, antonyms or/ unrelated* Adams jahjl 
(1958) found that without training, there was only ^but_a^J^pefHitit 
discrepancy between confidence calls and the actual peTcin^t of correct 
responses," again suggesting some sort of ^juggeEf£ive feedback system. 

" ked to 

draw lines of a given -l^xwehT'witbout receiving feedback on their 




Finally, Amnions (1956) describ^dj^&tu^ in ^whieh subjects were as 

accuracy]^ 8U ^lf^f^ 0 S an £° demonstrate increasing self-consistency 
"incorrect" 



arouna— anr 'incorrect" line length. Thi3 suggests the use of subjective 
feedback relative to some intrinsic standard, even though inconsistent 
with tfi§ experimenter's standard* 

The primary reason students are hot tojLd whether their diagnostic 
test responses are correct is to control any effect such feedback might 

have on test results. It has been argued, however, that when su^T 

correc t ive f eedback is withheld^ __s tuderits/ njay _ rely on subj ec t±v?j_ feed- 
back. Therefore^ instead of providing k/^uiff form effect upon teat score 
variance, it is reasonable that thfere ±6/ a [quite uneven effect upon test 
score variance, depending upon the nature or. accuracy of the subjective 
feedback systems employed and individual^ ! personalities as. .they relate 
to that feedback. If performance oh and, jtherefbre, the accurs^^ of 
diagnostic tests is influenced by any correctness feedback which the 
student receives, which is bettei u -a"hairlTO 

of feedback or a uniform system of extritjsjlc feedback? X U 

The main purpose of this paper is tcjreview and extend existing 
literature on » feedback as it relates to the testing situation; par- 
ticularly individually administered diagnostic tests in mathematics. In 
the paragraphs which follow* the existing literature on feedback is . 
restricted Jto include only that research jwhich is relevant to diagnostic 
testing. This_ research is theh.presratedi^aldng with its implications 
for educational practice. Finally, areas for further research are! 
identified and a research study currently in progress is described. 
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limiting the Review 



Massive amounts of research involving feedback have been conducted 
in the areas of programmed instruction, social reinforcement, test 
administration, persistence or frustration theory* personality , social 
psychology, incentives , congruency and dissonance theories. Unfor- 
tunately, hot all of this* research is relevant to the diagnostic testing 
situation. * ■/ \ / 



The literature oti feedback can be/ divided according to the three 



types of feedback usually identified:/ knowledge of response (indication 
of correct or incorrect) » knowledge pf correct response_(statement of j 
the correct response) and correctional feedback (statement of correct ; 
response and reason for: its correctness). Since only correct/ incorrect 
feedback is of concern in the diagnostic testing, situation, this review 
was confined to research studies involving knowledge of response feed-/ 
back. In less current literature this is referred to as knowledge of 
performance. , . / 



A large number of studies have examined the effect of knowledge of 

response feedback on subsequent task performance. Many of these, / 

however, are not relevant to the diagnostic testing situation. *Fpr J 
example, Dweck and Bush (1976) examined the performance of fifth-grajle 
students receiving "failure" feedback. In this study students were j to Id 
on each of four trials fib complete 20 digit- letter substitution problems 
in one minute; all students were stopped after 15 problems and told they 
hadn't done well. The results of this study Indicated] that such feed- 
back led to some or no improvement in performance, buti not to a § e cre- 
ment in performance. If findings on other studies were similar to this, 
one might conclude that telling a child he didn't do very well on a ^ 
diagnostic test item either has no effect or increases performanc^ but 
does not depress iti While this may be an appealing cbncius ion, <^ne 
major difficulty with the research exists; the task being performed was 
not siactlar to the academic tasks required in the usual diagnostic 
tests, especially those in mathematics. • I ' 

Like the study ,abov£ many knowledge of response feedback studies 
suffer ^^pm^his difficulty. As Means and Means (1971) pointed /out, ° 
much of thii~?Iiearch Is— limited to-simple physical, verbal or com- 
putational tasks that are not comparable to the complex deman ds/ of an 
academic testing situation. It is difficult to argue, for^xantoie, an 
equitablevcompsrison _betfreen the^tasks on die Key Math Diagnostic 
Arithmetic Test (Cpnno3ay ,JIachtman & Pritchett, 1971) and digit-symbol 
(Fremont, Means, 1970; St^rn, 1972; Dweck & Bush, 1976) , auditory 
discrimination (Sable & D*ly, 1972; Vianello & Evans 3 1968) * paired-* s 
associate (Van de Riet, 1964) or button-pressing (Schmeck & Btunihg, 
1970) tasks. This is important hot only because of title different cognitive 
demands of those tasks but alio because subjects' scores can /be affected 
by whether the|e tasks arev perceived as educationally important (Katz & 
Crreenbaum, 1963) . . 
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A ?±?±lar_ difficulty in many knowledge of response: feedback studies 
ha6 involved the use of multiple peffbrmince^ oh a single task rather 
than performa&ces i on a variety of related tasks. Ihjothir words, while 
many feedback studies involve repeated performance of the same tasks 
fe.g. * v digit-symbol substitution) and therefore thesame cognitive 
skill(s), academic testing situations have prdinarily involved per- 
formance oh a variety of tasks reflecting several cognitive skills. 
This is important; because' knowledge of response feedback may play an 
instructional role when a nearly identical task is repeated directly 
after feedback. Since academic tests, particularly diagibs tic ones, are 
usually arranged so that knowledge of response feedback * ojn one task 
should provide little direct help in performing a subsequent task^ 
knowledge of response feedback studies involving multiple performances 
bh a single task are Hot relevant to the diagnostic testing situations : 

In, summary, then* the research reviewed in this paper was limited 
to the knowledge of response literature relevant to the diagnostic, 
testing situation, i.e.* studies involving a variety of educationally 
relevant tasks. 

The Literatu re and Its Implications * > 



A number of research studies involving feedback have bekh' iden- 
tified which are relevant to^the diagnostic testing situation. While 
some of these have investigated knowledge of response feedback and its 
effect bh test performance * others have examined intra-personal factors 
like anxiety as they relate to feedback and performance. 

The study of knowledge .of response feedback as it relates tc* test 

performance has been approached in two different ways--by exploring the 
effect i*pon te**: performance of feedback bh (a) prior test performance 
and (b) ^rior tsst item performance, j In the first approach studies 
examining the test performance effec^ of feedback on prior ; test per- 
formance have generally been designed such that students ate tested* 
randomly. given sham feedback on .their performance, and then tested 
- again. In one such study Bridgeman (1974) examined the effect oh a 
scholastic aptitude test of feedback on previously administeired and 
obstensibly similar test. For one-third of the students, feedback 
fi consisted of a high score and the comment "Excellent! Your problem 
solving ability is among the best of all seventh-grade students," for 
another third a low score and the comment "Poor. Your problem solving 
ability is amoug^rhe worst of all seventh-grade students, " °ahd for the 
lc£Jt third no comment^ The_resuits indicated tfcjat students given 
* positive feedback scbred significant^ higher than students given 

negative feedback; no-feedback students scored about the. average of the 
■j two feedback groups. Gordon and Durea (1948) ,/±n a similar study with 
eighth-grade students, administered two forms of the Stanf ord-Binet 0 
Intelligence Test. Between the tests students received several IQ-type 
\; -J-*?* items. Some of the students received hp feedback, while others 

were told they did poorly both bh the between "test items' and at uniform 
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intervals during the second test. The results showed that the negative- 
feedback students scored significantly lower than the no-feedback group. 
Other similar studies have generally found that students who are praised 
or reproved for their performance subsequently perform about the same or 
better than students receiving no feedback , (Benton, 1936; Blankenship & 
Humes, 1938; Bernstein, 1968; Gates & Riss land, 1923; Gilchrist, 1916; 
Huriocki 1924; Hurlpck, 1925; Klugman, 1944; Schmidt* 1941; Tiber & 
Kennedy, 19645- ; 



Referring to studies like these, Anas tasi (1976) indicated that 
knowledge of response feedback which includes evaluative comments about 
students' performance or ability has a motivational effect, perhaps 
operating through the goals which subjects set for themcelvas in sub- 
sequent performance. It appears the^ that such knowledge of response 
feedback probably affects students' subsequent test performance; how-j 
everi the direction in w^^^at' performance is affected _is not clear. 
For teachers this suggests that feedback which includes evaluative 



comments about the students 9 performance or ability should be withheld 
before and during test administrations, diagnostic or otherwise. Finally, 
since knowledge of response feedback may not have the motivational 
effect suggested above, it is hot knowh whether such feedback in diag- 
nostic testing would influence test performance. 

It should be noted that in each of the studies cited above students 
were randomly given sham knowledge of results feedback on their prior 
test performance^ No doubt many students receded feedback which was 
contrary to their expected Performance. What_effect tfiis discrepancy 
between students 1 expected and reported performance may have had on the 
results of these studies is not clear; however* one possible explanation 
is presented later. 



Only three studies were identified which examined the effect upon 
test performance of providing students with immediate item-phy-item 
knowledge of response 'ieedback. Unlike the previous studies, none of 
these used sham feedback; rather, t^efee^ack^giyen students reflected 
their actual performance. The earliest of thgse studies (Morgan & 
Morgan, 1935) identified three possible effects of providing immediate 
awareness of response correctness: j (a) producing no appreciable mod-* _ 
ification of performance* (b) increasing effort, attention and critical 
observation and thereby improving performance, and (c) depressing 
performance through discouragement. [ In this study undergraduate psy- 
chology students were given a true-false test on "learning.' 1 Half of 
the group used a self-scoring answef sheet and a scoring 'device which 
allowed immediate knowledge of correctness; the other half used a 
mimeographed form of the test with delayed feedbacks In another study 
Angell (1949) used a puuchboard device to provide immediate feedback to 
undergraduate students for each item on mid- semester /quizzes in chem- 
istry. Compared to a control group, which received delayed feedback, the 
immediate-fpedback group scored significantly higher on the course final 
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examination. Unf prtunately, no cbmpatative data was available on the 
groups' quiz performance, and other intervening factors may have ac-j- 
counted for the difference in examination performance. Finally, Beesbn 
(1971) used a punchboard device to provide jfpfidiate, item-by-itjgm 
feedback during mid-semester quizzes and a final examination, the 
sample consisted of three groups of students— -a university class in 
mathematics for elementary teachers, a university clfss in remedial 
mathematics, and a junior high school class in general mathematics* 
During each of the ten quizzes and one _f taal examiratiori^students 
randomly received immediate feedback after each item on one-half of 
multiple-choice items and delayed feedback on the remainder; no stt 
received immediate feedback on the same half of any two consecutive 
tests. Care was taken in designing the t<£ 
one item would not {cue the answer to an 

examination* no sigr 
ces under immediate 



Except for the final 
between test |>erf 6 



ksts so that feedback bh 
:em elsewhere in the test 
Lf icant differences were' found 
and delayed feedback con- 
in favor of the immediate 



ditions. There was! a slight trend, howe 
feedback test perforn/mc^- 

Based upon these ^urfiss, it would appear that i^»diate itei-by- 
item knowledge of resptmse feedback does not depress (and may even 
improve) 'student p^rforw^cfe, on fbrcedHdfioice Ctrue-fclse» nnilfciple^ 
choice) academic tests. Furthermore* /there is some indication that, for 
whatever the reasons* such immediate feedback may increase performance 
on subsequent tests bvar the same content. Since, however, djLagnos tic 
tests do not usually ihvblve fbrcedr^ 



hot be generalizable to the diagnost 



knowledge of resultps feedback from a 
tes ting device , ma; 
conclusions to iud 



j ions may 

testing sit.ua tion. Receiving 

person, rather than an impersonal 



cast even further doubt up<m graeralizwa^these 
idualty administered diagnostio^tefftihgl^ 



A number of studies have examined various intra-persotial factors as 
they interact withjknowledge of results feedback and perfomahce._ One 
such intra personal .factor thathas been a||ociated_with test perfor- 
mance is anxiety. Feldman and Sullivdn (1971) and Rbsenzweig (1974) 

have reported that [students with lbwer\ test anxiety performed better 

than students with high test anxiety^ \Cohen (1972) found _a relationship 
between increases in college students and decreases in 

their verbal/numerical aptitude test performance. 

Several studied have investigated th^ effect of feedback on anxiety. 
Cohen's study, hi found t|hat feedback 
discrepant with studehti r eacpec ted _ 

and Sullivan|_(1971) reported that 
test anxiety was unaffected by positive vex 



performance 
ice - s t imula ted tes t anxiety « 
Lementary school children's 
al reinforcement of the ' 



^-Bernstein (1955) foAnd the mere presence bf\ the teste 
scores bh the Thematic Aperception Test. 



1,:: 




influenced 




first correct response on an intelligence test v Finally, McMahon 
(1973), in a study of the effects of feedback on test aaxiety, found 
that receiving detailed knowledge of test results increased college 
students' test anxiety. 



it would appear from these studies that knowledge of response 
feedback on test performance probably leads to increased .anxiety which, 
in turn, impedes subsequent performance. However, only Cohen included 
all three factors— anxiety, knowledge of response feedback and per- 
fprmance^in a single study, and that study only suggests that feedback 
discrepant with students/ expected performance leads to increased 

anxiety and decreased subsequent performance. Although Cohen's study 

involved feedback in the form of scores rather than evaluative comments 
like "excellent" or "poor," thte feedback was from a previous test, not 
item-by-item feedback on the same test, therefore, the relationship 
between immediate item-by-item knpwie^ge-of-results feedback, anxiety 
and test performance remains unclear. 

In an earlier discussion it was noted that research pi^eciupes- T -^ z ~~ 
involving sham feedback on previous test per^nnaMe^M^ to 
discrepancies between students' expe^ed^f Redback and that which was 
reported. Since such d^cr^panciesoccurred within groups receiving 
sham pbsit±ve_feedbaclc~as well as _negative feedback and since audi 
discrepancies seem to lead to poorer subsequrat perfoSmOTce; this may 
explain the lack of consistent findings in studies of feedback con- 
taining evaluative comments. 

, Further examination of the Cohen study suggests a possibl^second 
intra-persbnal f actor~expectatioh. Although this may only be another 
way of looking at the effects of anxiety, it appears to have Potential. 
Brldgeman (1974) indicated that self-expectancy deserves more attention 
from researchers, and Kulhavey (1976), in the context of instruction, 
stated that how students' expectations influence their use of feedback 
is a prime area for future research. 

No other studies involving intra-persbnal factors were identified , 
which are relevant to the diagnostic testing situation. However, 
several studies— have examined intra-persotial factors as^ they interact 
with feedback and performance on non-academic tasks. These are pre- 
sented to identify factors which may hold promise for futifre research. 

One such intra-personal factor which has been examine d^, in relation 
to knowledge of results _feedback and non-academic test performance is 
self-concept. Using sham feedback on a test reflecting "sensitivity to 
other people," Shrauger and Rosenberg (1970) studied the effects of 
feedback on college students' subsequent performance oh a digit-symbol 
task. Task performance following poor-sehsitivity-to^bthers feedback 
was generally worse than performance following high-sen~itivity-td- 
others feedback; however, this was found to be mainly attributable to 

the consistency of this feedback with students' level of self-esteem. 

Specifically, Shrauger and Rosenberg found that high self-esteem students 
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receiving positive {high-sensitivity) feedback improved their perfor- 
mance, while the reverse was _ true for low sfelf^eateem students receiving^ 
negative (poor-sensitivity) feedback. The performance of high self- 
esteem students receiving negative feedback and low self-esteem students 
receiving positive^ feedback was unchanged. In a similar study. Stern. 

{1972) examined the effect of sham feedback on digit-symbol task 

formance tipbti subsequent digit-symbol task performance. Once again task 

performance following negative feedback was generally worsje than per- 
formance following positive feedback^ Unf ortunately. Stern found the 

r evers e relationship b etween s elf —cone ep t and feedback; positive feed- 
back more greatly affected low self-concept students, while negative 
feedback more greatly af footed high self-concept students. 

As descri^^_^ove^€Ee interaction between knowledge of results 
f fedbackT^^flS^^ncept and performance was eaaiiiied ik only two iden- 
tified studies and their results conflicted. Therefore, ±t remains 
unclear as to whether /self-concept is helpful in explaining any re- 
lationship between feedback and academic or non-academic test perfor- 
mance. 

The results of several studies have suggested other ihtra-oersohal 
factors vhich may be helpful in explaining any interaction between 
knowledge o'~ Espouse feedback and hbh-academic performance. Research 
in tb<: a«a of "locus of control" has indicated that when receiving 
negative feedback' from adults, girls tend to attribute failure lo a lack 
of ability (Dweck_S Bush* 1976; Dweck & Reppticci, ,1973; Nicholls, 1975) 
and to show J a decline in subsequent performance (Dweck & Bush, 1^76; 
Dweck & Gillard, 1975; Maceoby, ^966; Nicholls, 1975; Verqff , 1969); 
boys ; on the contrary, were shown to attribute failure to controllable 
factors like lack of ^effort and to displa^r improved subsequent per- 
formance. In the area of introversion/ extroversion^ Fremont - 9 Means and 
Means (1970) found introverts given negative feedback displayed sig- 
nificantly more anxiety than extroverts, which presumably would lead to 
a decline in subsequent task performance. 

"Based upon these studies, one might conclude that knowledge of 
response feedback has a differential effect on student taSk performance * 
depending upon students 1 locus of control pr "introversion/ extroversion. 
The locus of control research might even lead one to conclude that the 
effect of feedback varies with the students' sex. - None of these studies 
included academic tasks or Immediate iten^by-item feedback. Therefore, 
while such factors hold promise for future research, such conclusions 
may hot be generalizable to the diagnostic testing situation. 

irch 



The existing research on knowledge of response feedback as it _. _ 
relates to the testing situation, as presented in this paper, has lid 
to three conclusions: 
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(b) immediate item-by-item knowledge of response feedback 
does not depress (and may improve) student performance . 
on forced-choice academic tests; and . - _ 

(c) knowledge of response feedback on previous test performance 
which J^discrSpaht with students 1 expected performance — 
probabl^ Leads to increased anxiety and decreased subsequent 
performance* 

Conclusions with respect to diagnostic testing were lacking 
because of the general lack of correspondence between die research 
conditions and the diagnostic testing situation. Aside from performance 
on non-academic tasks, factors leading to this lack of correspondence 
included knowledge of response feedback which included evaluat T e 
comments like "excellent" or "pobr^" forced-choice academic test 
formats like true-false or multiple-choice, and feedback provided 
by a device rather than a person. » 

In light of the previous research (or. lack of it), there are three 
areas of heeded research. Stated in the form of questions, these are: 

(1) In the diagnostic tgggitis situation* does ^"""^diate itenfr- 
fry-item knowledge of response feedback affect performance 

on a diagnostic test? 

Previous research has suggested that such feedback has little effect 
upon performance on forced-choice academic tests. To_ answer tfiis 
question , further research, heeds tb be conducted in which test items 
are free-response and feedback is provided try the. tester, rather 
than by a, mechanical device. 



(2) In the diagnostic testing situation, which intra-personai 
f a^£or^-ifMigy^4ieip explain the relationship between 
immedl -te item-by-item knowledge of response feedback 
and diagnostic test performance? 

Although rather inconclusive, previous research has suggested that 
the relationship between feedback and subsequent performance may 
not be a simple one, but is influenced by personal, factors. Anxiety 
appears to be a highly probable factor to help explain this relation- 
ship. Other potential factors suggested in the literature tafciude 

student expectations, self-concept, locus of control and introversion/ 
extroversion . 

(3) Xru^the diagnostic testing situation, does students' intrinsic , 
subjective knowledge of response feedback affect their 
performance on a diagnostic test? 

It was proposed earlier in this paper and supported by some research 
that, in the absence of tester feedback, Students substitute their 
own idiosyncratic systems of feedback. However, with the possx^ie 
exception of Ros s (1927), no research was identified which dealt 
with subjective feedback as^ it relates to performance on academic 
oruiiagnostic tests. Because of the total vola of research in this 
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area, a series of sub-questions needs to be answered : When the tester 
withholds feedback during a diagnostic test, do students provide 
themselves with knowledge of reepbhru feedback? How accurate is 
this feedback? Does it affect diagnostic test performance? Does 
this feedback interact with tester-provided feedback to affect 
performance on a diagnostic test? The small amount of research bh 
the discrepancy between feedback and expected performance relates 
to this last subdues tion, suggesting the likely possibility of such 
an interaction. 

A Study 

Based upon a review of the literature bh feedback as it relates 
to _^ ia S?°8tic testing, three major questions or areas of research 
??*e_posed^ T° _^ e lP P rd ^ide answers to these questions, a research 
study was recently conducted by the author. 

The purposes of the study were (1) to determine if item-by- item 
knowledge of response feedback (induced self , tester-provided, both) 
affected students 1 performance on a diagnostic mathematics test, 
(2) to explore the accuracy of students' intrinsic feedback as reflected 
in their self-reported knowledge of response .feedback on a diagnostic 
mathematics test* and (3) to examine the relationship between 
students 9 performance expectations and performance bh a diagnostic 
mathematics test. Organized. by their appropriate general qu<»s^ions, 
the null hypotheses of the study are formulated below: 

(1) Does item-by-item knowledge of response feedback affect performance 
bn a diagnostic mathematics test? 

(a) No significant differences in diagnostic mathematics test, 
scores will be observed between student 3 receiving no 
knowledge of response feedback and students receiving 
i tem-by- item ^ induced self, tester-provided* induced 
self followed by tester-provided) knowledge of response 
feedback. 

(2) In the diagnostic test situation, do student expectations influence 
the effect item-by-item knowledge of response feedback has upon ~ 
diagnostic test performance? 

(a) Differences in the diagnostic mathematics test performance 
of students expecting high and low test performance will 
not differ significantly between students receiving *item- , 
by-item knowledge of response feedback. 

(3) How accurate is students* induced self feedback on a diagnostic 
i mathematics test? 

(a) Students 1 actual scores on a diagnostic mathematics test 
will hot differ significantly from students 1 scores as 
indicated by their item- by-item induced self feedback. 
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Method 



the sample consisted of 98 f pgr tit-grade and 94 sixth- grade 
students from the Washington Elementary School district ^Phoen±x^ 
Arizona^ these students represented four classrooms at each grade 
level randomly selected from district classrooms* None of the 
classrooms theoretically represented a homogeneous ability group 
in math, reading or any other area. 

Mat e ria ls 

Two specially-constructed- diagnostic mathematics tests were used 
in this study, one for each grade ieyeii TJjese tests were designed 
c 9 ^5^?? _?he major ma thematics content for _the_grade level in which 

*?_!? a ?_?*®4i ta ?^? y? 1 '? ^^^?^ _^°_? we ??y" : ^??_p??? 8 »_ 

with corresponding items in eacu part testing the seme mathematics 
concept or is kill. Test items in each part were arranged in ascending " 
fashion, with earlier items testing concepts or skills which (a) appeared 
logically prerequisite to those tested in later items, or (b) are 
normally taught prior to those tested in later items. Within each 
twenty-item part* care was takea so that feedback on any one item would 
hot cue the answer to a subsequent item. All test items were free 
response, and each item was printed on a separa 4 - <* f iye-by-eight inch 

page. Thus, at each grade level, the diagnostic mathematics test 

consisted of two parallel sub- tests, each surveying t&e same major 
mathematics concepts and skills for that grade level and each arranged 
in ascending order* 

The two part test was used because, whatever effect feedback might 
have in the first part of the test, it was felt that this effect would 
be even more apparent in the second part. " For example, if feedback 
produces performance-debilitating anxiety, then not only should test - 
performance on the first part be depressed (compared to a non-feedback 

8?95P) » _^ ut _?®??_?? r ?? r ? a ?? c _9?_ t: ^ e _? e ?? tt ^_P art sho^id be even further 
depressed (compared to a nou-f eedback group) • - 

Procedure 

Students from each classroom in the sample were randomly selected 
in groups of five, and each of these groups were in turn randomly 
assigned to one of four feedback treatment groups — one to receive 
no feedback, cne to receive knowledge of performance feedback from 
the tester, one to indicate after completing each item whether they 
expected their response to be correct or incorrect (induced self 
feedback), and one to receive induced self feedback followed by tester 
feedback. An attempt was made to assign students so that all four 
classrooms > t eacji grade level were equally, represented in each 
treatment group. aJi students were tested by the same tester in a 
room other than the usual classroom. 



71 



9 

ERIC 



-67- 



As the testing began, the students were told that they were going 
to take a two-part test which would help identify any areas of mathe- 
matics in which they might heed some help. Since no data had been 
previously collected on the equivalence of the two test parts, half 
of the students in each treatment group were given one part first 
and the other half the second part first. After writing their name 
and teacher on the front cover , ^ the students were ins true ted to 
briefly^ look through the 20^items and write the number of items 
they expected to answer correctly. 

When this was done, students received different instructions, 
depending upon to which of the four feedback groups they had been 
randomly assigned. In the first group (the nonr-feedback group) , 
students, were told to answer each item and then mark an ,f X" in the 
box to the right of the problem to show it had been finished. Students 
in the second group (the induced self feedback group) , were instructed 
to answer each item and then mark one of the following words: 
"RIGHT," "right, H "wrong" or M WROMG." They were to nark one of the 
capitalized words if they felt certain* their response was right or 
wrong, and mark one of the words in lower-case if they felt their 
response was probably right or wrong. After responding to each 
test itemV sfudents in the third group (the tester-provided feedback 
group) were told to mark an "X"_ih the box to the right of the problem 
to_show it had been finished. The tester than pointed to the word 
"RIGHT" or "WRONG" next to the problem, indicating the correctness 
of the students v responses • Finally, in the fourth group (the 
Induced self and tester-provided feedback group), students were told 
to answer each item and nark one of Ae worte "^GHT, "fright," 
"wrong" or "WRONG" to show how certain they were of their response 
correctness. The tester then pointed to the word "RIGHT" or "WRONG" 
to indicate whether or net the students 1 response was correct. The 
students in all feedback groups were hot allowed to proceed from one 
item to the next until all five members of the testing group had 
completed the item. 

When the students had couple ted the first part of the test, 
they were given a one or two minute break and then Proceeded on to 
the second parti As with the first parti they were instructed to 
briefly look through the items and write the nufiber of items they 
expected to answer correctly. The students then completed the test, 
following the same instructions as in the first part. 

Thus, in randomly selected groups of five, fourth and sixth- 
grade students were administered a two-part, ascending diagnostic - 

mathematics test A Before beginning each part of^tiietest^ students 
indicated the number of items they expected to answer correctly i 
As they completed each test item, students either received no 
feedback, self feedback, tester-provided feedback, or both self and ; 
tester-provided feedback. Over a four week period, two weeks for 
each grade level-, each test administration took approximately 40 
minutes. 
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Feedback In Diagnostic Testing 



Table 1 

Descriptive Statistics for Diagnostic Mathematics Test Performance 



Feedback Group Grade n Part A Part B 

Actual Expected Actual 



Mean SD Mean SD Mean SD Mean SD 



No Feedback 


f 


29 


17.34 


2.52 


13.76 


3.53 


16,93 


2.31 


14.14 


3.47 




6 


22 


16,41 


2,32 


11.90 


4.93 


15;54 


3.79 


11.68 


4.60 


Induced Self 


4 


25 


17.00 


3.00 


13.48 


2.94 


17,12 


3.00 


14.32 


2,82 


Feedback 
























0 . 


26 


15.42 


3.32 


10.62 


3,97 


15,54 


3.56 


10.73 


3.92 


Tester Feedback 


4 


24 


17,17 


3.28 


12,54 


3.96 


15.58 


3,05 


13.62 


3.47 


* 0 


6 


23 


16.04 


3.76 


10,70 


4.10 


13.48 


3,91 


10.96 


4.00 


Induced Self- 


j 


20 


17.40 


4.22 


13,00 


3.92 


15.60 


3,12 


13,90 


J.29 


Tester Feedback 




















t 




6 


23 


16.13 


3.22 


10.30 


3.88 


12.39 


3.82' 


10,48 


4.39 
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Feedback in Diagnostic testing 

Table 2 

Two-Way Analysis of Variance of Diagnostic Test Performance 



Grade ? est Source of Variation SS df MS 



Part 



*£ <»05 
**£ <.01 



Main Effects 


123.14 


4 


Feedback Group 


35.52 


3 


High/Low Expectancy 


101.05 


1 


2-Way Interactions 






Group x Expectancy 


33.41 


3 


JUvp X UH6Q 


1 KC. CO 
±J\J « JJ 


7 


Residual 


1075.05 


90 


total 


1231.60 


97 


Mate Effects 


65.52 


4 


Feedback Group 


.13.22 


» 3 


High/Low Expectancy 


58.85 


1 


2-*Way Interactions 






Group X- Expectancy 


27.71 


3 


Explained - 


93.23 


7 


Residual 


925.76 


90 


total 


1018.99 


97 


Main Effects 


136.15 


4 


Feedback Group 


40.66 


3 


High/Low Expectancy 


102.66 


1 


2^Way Interactions 






Group x Expectancy 


172.70 


3 


Explained 


308.86 


7 


Residual 


1310.35 


86 


total 


1619.20 


93 


Main Effects 


168.95 


4 


Feedback Group 


43.93 


3 


High/Low Expectancy 


132.98 


1 


2-Way Interactions 






Group x Expectancy 


105.42 


3 


Explained 


' 274.37 


7 


Residual 


1368.18 


86 


total 


1642.55 


93 



4 A Main Effects 123.14 4 30.79 2.58* 

11.84 .99 

101.05. 8.46** 

11.14 .S3 

22.36 1.87 



16.38 1.59 
4.41 .43 
58.85 5.72* 



9.24 .90 

13.32 1.30 
10.29 
10.50 

34.04 2.23 
13.55 .89 

102.66 6.74* 

57.57 3.78* 

44.12 2.90** 
15.24 
17.41 

42.24 2.66* 
14.64 .92 

132.98 8.36** 

35.14 2.21 

39.20 2.46 
15.91 
17.66 
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Table 3 



Comparison of Students' Actual Diagnostic Test Performance and 
Performance Reflected in Students 1 Induced Self Feedback 



Feedback Group Grade n Score | Part A 



iart-k 



Mean SD ,df t Mean SD df t 



Induced Self ' 
Feedback 



Self 17,56 1.94 
4 -25 Actual 13.48 2.95 24 -7.45** 



17.52 1.74 

14.32 2.82 24 -5.72** 



Self 16.00 2.74 16,12 3.20 

26 Actual 10,62 3.97 25 -6.91** 10.73 3,92 25 -7.44** 



Induced Self- 



4 



Self 16.70 2,66 16.55 2,48 

20 Actual 13.00 3.92 19 -4,65** 13.90 3.29 19 -4.36** 



Self 14.78 4.17 >~ x 13.39 4.81 
6 23 Actual 10.30 3.88 22 -6,80** 10.48 4,39 22 -3,69** 
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7 Results- 1 



, Measures of equivalent-forms test reliability were obtained 

"Ttor the two -f orjwJgjg the fourth-grade diagnostic mathematics test 
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and the s±3Cth-grade test. To avoid the possible effects of feedback 

°?_? lie r ?^^^ > ^^ t ^??»_ 0 ?^y ? r 9? studentis receiving no . 

eedback were used; half the students at each grjade level had received 
ohe fcrm first, and half the other form first. The coefficients of 
equivalence for the fourth and sixth-grade teste were respectively 



Students' expected and actual performance on the diagnostic 
mathematics tests are displayed in Table 1_. ,'i A k * 2 factorial design 
wa8 ised to ascertain the effects »of iteffl-by-itefit knowledge of 
response feedback for each part of the diagnostic mathematics tests. 
At both grade levels multi variable analysis of variance indicated no 
significant dif f erenceo in "performance between students receding tfe 
feedback on the diagnostic mathematics test and students receiving 
knowledge 6f response feedback (F-l«15, df-2/93 end F.-i % .54^ df-2/89 
for fourth and sixth- grades respectively). Because of the overall 
lack of significance, univariate F/s were not computed. 



- - - • ■_ _/ [_ n _ 

two-way analysis of variance procedure I was used to ascertain 

whether student's .performance expectations Influenced the effect 

of knowledge of response feedback on student r s diagnostic mathematics. 

cest performance. __S tudents were separated iflto high and low jl 

performance expectancy groups according to thi mean expected performance 

on the fits t part (Part A) of the diagnostic matheratics tests at 

*ach grade level (17.22 and 15.98 for grades four and six respectively). 

. he actual^ test performance of students expecting high and lav / 

performance was then compared £br the four feedback groups. The 

results of \the analyses of variance are presented, in Table 2. The 

only significant interaction was in Part A for sixth-grade students. 

Since one would expect this significance to 'bei nSaintained for Part B, 

it may have £>een a chance occurrence. 0 1- -•' l! 

A : ■■ J.i . '.>' .'• , 

The accuracy of s tudents ' scores as indicated by their itfem-by-iter 

induced self ^feedback was checked by comparing these scores to students' 
actual performance. A summary of these scores jand analyses is shown 
in Table 3, For both grade levels and for /both feedback groups \ 
involving induced self feedback, students consistently and significantly j 
self-reported greater performance thai that actually demonstrated. . j 

It is interesting to note that the difference remained significant 
in the second part of the diagnostic test, i even though two groups 
of students generally received some dis conf irma t ion of ' their self- 
feedback from the tester. V ! j 
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Discussion 



The present study explored questions relative t</ item-by-item 
knowledge of response feedback as it relates to diagnostic testing 
in mathematics. The results would seem to ^lehd^siippbrt to the 
argument raised in the introduction that item-by-item knowledge of 
response feedback does not affect performance 6n a diagnostic 
mathematics test. This conclusion, however, must be qualified 

It was argued J:hat in the absence of tester feedback, students 
substitute their own subjective feedback. If this is true; then, 
students designated as receiving no feedback in this study were 
actually receiving subject live feedback. Thus, this conclusion 
must be qualified to indicate that item-by-item feedback affects 
students' diagnostic test performance no differently than students' 
subjective feedback. j| - \ 



L The -results of this study seem to further suggest that students* 

performance expectations d£ not influence the effect of knowledge 
of response feedback on diagnostic test performance. A Significant 
interaction between students' expectancy and feedbagk was found fbr j 
sixth-grade students on Part & of the diagnostic test, but^ffais ! 
appears to be likely the result of chance. Performance expectancy* 
therefore, does .not appear %o be an intra-^ersonal factor which interacts 
with! knowledge of response feedback in affecting students' diagnostic 
mathematics test performance. \ 

l ■ ___ \ A _ 

]? n _the present study students' scores oa the diagnostic mathe- 
matics tests , as reflected in their self f reported itsn-by-item knowledg 
of response feedback, differed significantly from their actual scores 
Students consistently self-reported performance Mch was greater 
their \ actual performance. This suggest that * jdents 1 induced self 
feedback on a diagpog tic m athematics test is relatively inaccurate, j 
If s tudehtsr^sub j ective knowledge of response- feedback is reflected j 
in their self-reported feedback* as induced in this study * then ! 
students' subjective feedback is inaccurate.^ The fact that students 
tended to rate themselves as doing better thai^ they actually were 
supports Cronbach's (1960) observation that children are often enormously 
pleased with very inferior responses. / 



; The prior review of the literature on knowledge of 1 response feedback 
revealed no conclusions with respect to the diagnostic testing situation. 
One purpose for conducting the present study was to begin empirically 
investigating and answering questions concerning the use of such / 
feedback in diagnostic mathematics testing. While the results appear 
to suggest that providing item-by-item knowledge ,of response feedback 
on diagnostic mathematics tests affects students' performance no more 
than withholding: such feedback, intra-personal factors other than f 

: : M/ I / ' 
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perf briwnce p^ectahcy may exist (e.^g., anxiety or self-concept) which 
indicate differential effects gf feedback on diagnostic test* performance. 
Questions concerning students' intrinsic, subjective knowledge of 
respcv »>■;. feedback in the diagnostic testing situation remain largely 
unanswered; this study' has only suggested that such feedback may be 
relatively Inaccurate. / «■ 



In this: paper the issue of providing febwiedge of response 
feedback in diagnostic mathematics testing "las Been raised. Although 
an initial attempt was- made to investigate oeveral questions relevant 
to knowledge of response feedback in ; diagnostic testing* a number 
of questions remain* and further research needs to be conducted 
before the i«sui* will be resolved. ' 
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Reaction Paper 
to 



Feedback In Diagnostic Testing 



_ Lloyd Hutchi^is. 
Francis Marion College 



? ??_^?85?_with a few general reactions sad then deal 

with a particular interpretation of the results which, in my opinion , 
are important in the planning of the next level of research in this 
area. 

Drs. Romberg and Uprichard, in their paper, discussed classes of 
research such as discovery-oriented research and research for confirma- 
tion. At the end of the conttauust we have to have considerable ii*i:eren~ 
tial rigor because our purposes are different for discovery. While it 
is generally an influential mold, it Vs. much more important to consider 
every^ possibility and taake^ accommodations to logistical needs that 
otherwise could not'be <tone. We should not be deterred from pursuit g 
our interests simply because we can't always please the people who 
spend alot of time shocking rats. In a discovery study , an exploratory 
investigation, there are some informalities in the analysis but they 
are perfect y legitimate in this context. 

Another point I would like to make has to do with the partitioning 
of students into what could be considered to be emotional categories 
for further research, e.g., high-anxiety people, secure people, etc. 
I think tha- this is extremely useful and th^t it will allc - us to move 
more quickly in the next stage. 

1 would like to address an aspect of research in the second stage 
that I feel is probably of particular importance. Because it's important 
in the second stage do^s not mean it is not important in the stage 
represented by Dr . Engelhardt 1 s study. That is,, I think that his study 
had to be done in this way before we could do wh^it I'm going to suggest. 
It^s very definitely not a criticism of his procedure, which I think is 
correct. With this in mind, i would like to r^«e the following for 
consideration. 

At the next level of research I think wc must partition our 
measurements. We must measure the effects of positive r.d negative 
feedback separately •_ If we measure feedback as a Qesta?t, a complete 
entity, we will hot be testing whether any effect e:*istt ? but whet, ^r 
the effects cancel each other. Assume we have a situ^tiou <n whi^! a 
child givet< approximately 50% correct and 50% incorrect responses. 
That is, a ch.-.Id receives a positive reinforcement in one case and a 
negative reinforcement in the other. It's probably reasonable ko assume 
that the effeefs will cancel. If m m look, for example , at the t^ble of 
means and standard deviations, .we 'o have approximately 50% correct 
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respbnse in every instance. Consequently, in the next step we might 
want to measure the positive and negative reinforcement differently. 
That is, Veep track of the amount of positive treatment and the amount 
of negative treatment applied. 

Another adjustment I feel is important is the control ct the rein- 
forcement variable. Rather than taking the average of positive and 
negative effects in soua degree we should compare intervals where we 
know exactly what the degree of treatment was. This, of course, would 
require a pre-testing and a fairly elaborate sorting of response on 
some equivaleut pre-te^t form. But, I think if we intend to make use 
of the procedure in clinical situations we reaiiv need to know the_ 
response to a fixed treatment, not the mean effect of some group of 
people* 

Regarding the conclusion, say we did a second study in which the 
child was being toid he/she was wrong about half the time. In addition, 
let's say there was no difference between the feedback by the tester 
and the child's own induced feedback. We cannot ^assume from this that 
this relationship will hold over the entire range. This may be, and 
very likely is > a catastrophic phenomenon. When you react: a certain 
level of stimulus, things happen very quictty. I think that a child 
who was told he/she was wrong 85% of the time by an authority figure 
might very well experience some considerable effect different from 
the child's own induced by anxieties over suspicion he/she was wrong 
much of the time. Similarly, I think there would be comparable difference 
in positive reinforcement. 

Now, by catastrophic phenomena again, we mean the effects are nnt 
linear. We actually need to have fixed treatments over intervals of 
response of 10% or so, but this would be difficult to do. I think 
that in the mid-range ther* isn't going to be a very large difference 
but iu c whet; we move awa$ from_ the mid -rt.uge where* for example, a 
child is receiving a high \ ^rcentage of positive reinforcement (or 
negative reinforcement), there will be some important sf f^ct uu per- 
formance. The point +s, we have to have fixed effects, not average 
effects, and we have to compare tester feedback with self-induced 
feedback at different intervals before fc3 really have something that 
will aJlbw us to make clinical decisionr . 

If the point of providing feedback is to improve bur measurement 
of the cognitive construct - to reduce it* being confounded by anxiety 
or something of that sort, then it is extremely important to us* fixed 
effect and to measure in intervals. 
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Counting Performance and Achievement 
Some Preliminary Observations 



Leroy G. Callahan 
SUNY/Buffalo 



Obviously, the first skill of any consequence that, children 
must master is the ability to count. ...No syst^ can afford 
to fail in developing this skill at a rather early point in 
the child's learning experience. (Buchanan, p. 33) 

The most basic of all skills is that of competence in the use 
of number systems for counting, comparing, ordering and 
measuring.^ (Hilton, p. 88) 

Basic_Skiils ^include) 

A firm understanding of the basic meaning and uses of numbers 
for counting, comparing and ordering. (Rubens tein, p, 177) 

Renewed concerns with Sasic skills in mathematxci have focused soma 
attention on the counting process, as suggested by the quotes above 
taken from Conference ah Basis Mathem cical Skills and Learning , Vol. 1 
(1975^ Associated with these conceit is the interest in earl? identi- 
fication of childrei^ may have difficulty in learning basic mathema- 
tical skills. The "Project for the Mathematical Development of Children 
(PMbG) group has been involved with examining and describing some aspects 
of the enumeration process in young ctaiid*<?u » ^ processes, 
especially tl.c role of perception, irjv<v*ved it*» enumeration havs been 
of^int^.reat to psychologists for over : x ccuVirv' (eacai};*:: Jevons, 
1871). 

This paper explores some of the cognitive processes that.appear to 
be involved with counting, and also reports on observations of first 
graders involved with performing rote and rational counting tasks. I, 
and some of my students? have been involved with interviewing small 
numbers of ^i^st graders for- the pasf.^four years^ This yeax as part of 
a more comprehensive project we were able to carry out about one thou- 
sand interviews of first graders. The dat* are presently being pro- 
cessed. Observations reported in this paper are based on a smaller 
number of interviews carried but in previous years. _ Finaiiy^ some 
speculations will be made on the diagnostic value of these tasks in 
predicting learning strengths and weaknesses of students within a broader 
context . 

_?**e subset of tasks -on the int€r»7iew concerned T '1h counting involved 
two aspects, rote counting and rational counting. Tfte former involved 
the examiner (E) asking tlje ch:tid, "How far can yon count?" and ui*cr* 
"Can you *how me?" The child ?as also asked to cocut on from a jos-it in 
the system other than one, and to count backward from different points 
in th* system. The rational counting tasks included counting 3, 7, 11 
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ahd 16 counting blocks from a pile; choosing a dot card with N dots when 
presented with a trio of dot cards (N, N-i, N+i); a sorting task with 
dot cards with different arrangements of 5, 7 and 10 dots which were ,to 
be sorted onto criterion cards with displays of 5, 7 and 10 dots; and a 
task requiring ordering of dot cards and humeral cards* 

Rote counting can be described as a verbal chain (Gagne, 1970). A 
series of words are linked in an arbitrary sequence, trough modeling 
and/or repetitive practice children may becdTC proficient in performing 
this verbal chain. In the interview observations* could be made on the 
length of the verbal chain, poi nts in th e chain that appear to h& more 
difficult, and other factors th at may af fect performance. 

One general ^observation was that first graders differ_in their ^ >te 
counting performance on entering first grade. Danmark (1975) reported 
that when (EJ terminated the chain at "thirty-five'Vqyer 50% of approxi- 
mately 200 first graders reached that point; about 16% reached "twenty- 
nine"; about 12% reached "xlheteeh"j about 9% reached "ten"; and abo at 
10% could hot get to "ten" in the chain. In bur procedure (E) did not 
terminate the count until one hundred. 

Of about 40 observation mate from this batch of students * one 
could only count to 10 or "less; two stopped between 11 and 20 1 eight, 
between 21 and 313; eight between 31 and 40; ones between 41 and 50; three 
betwp^x 51 and 60; and ail the rest (18) made it to one hundred. 

Although the sample of performance being reported on was smsll and 

nbh-rahdqm, it was interesting tc note that if a student made it to 

"sixty" in the «haih they then could make it to oar hundred. Another 
observation was that most of the terminal points in the chain were at 
the point of movement into a new decade, i # ?i»_^» Further^ 
soii*i* «* T served that even for those able to mafes the count to on* 
hurt; a. .ere was hesitancy and pauses at some of these points. Using 

analogy from the physical sciences , it appeared that a relatively 
sis^ii amount of *r s of cognitive energy are required to continue the 
flow of the verbal chain within a decade* but additional ergs are 
required to cross the threshold to the liexi decade. In speculating on 
why students wao make it through the fifties could make it all the way 
to qnd Hundred, one possible explanation might be the linguistic simi- 
larity between the dTecade nar^s sixty, seventy, eighty, aiaety a" I tfes 
familiar six, seven, eight end nine^ With thst exception of forty ^ there 
is a degree of dissimilarity between twenty* thirty* forty> fiff;? (where 
students were terminating the chain) and the familiar two, thrdfr,, four 
and five. * 

A few further observations on rote counting. There of ten was r, ^ 
discrepency fc^tween \>jw far_r.he children cay they can coi acd how £«r 
they can, fact, c^tint. Typically, the point that fey say they can 
count to is less than where ttu*y can count ±n their perf ormance. 
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Ano Cher rather common observation was the pride so many youngsters took 1 
in "showing of f M their counting ability. Counting to one hundred may 
not be a particularly fun thing for older children, but many of these 
children seemed to enjoy being the solcist in a counting performance. 

Although it was an unsystematic inquiry, many of those able to 
count to one hundred were asked, "Where did you iep.ru to count so well? 11 
The most common responses were .associated with older sisters or brothers 
parents (usually the mother) or in a few cases grandmothers. Very f ew 
indicated the school. Ogi^tree (1970) alluded. to this influence wh^n he 
stated > 11 ...the intellectual part of rote counting lies tn the fact that 
number words are strictly ordered, and whenever the child muddles tip the 
sequence, or skips a word, his older playmates or adults correct him. 11 
Ausubel (196^0 consnented, a nViber of years ago, on the importance of 
burnishing acceptable models of speech and supplyins corrective feedback 
in relation to early learning, especially for the disadvantaged child. 

S.tudent^ were asked to count-on from 6. Our observations were very 
similar to thos<* reported by Denmark (1975). The Majority of students 
could perform the task. Some had to have the direction clarified by 
cueing. Relatively few were unable to perform after the directions were 
clear. 

Students were asked to count backward from 10; c ntMy^.r less than 
tea (6); and a nuinbsr greater zh&xi ten (12 or 13) . Of about 40 obser- 
vations made, about 14 were unable to count frow 6, 10, or 12; two wsre 
able to count from six but not 10 or 1? ■ ^re able to count from 6 

and 5P but bet 12; and eighteen were « 3?_^* ro ? I? 

Denmark reported that about 80% of tt ders could count back- 

ward from six once the directions wrc zo th<im (some nt -ided 

cueing). We also would cue the st v den«~ ...like 1 ten* 1 1 nine - 9 * 
'eight. yet this group of first-gradirsreflected somewhat more 
difficulty than the Florida and Georgia children. Counting backward 
from twelve was very difficult. 

Observations of the backward counting task inci uded the evident 

la^lt of experience by rany children in any ba ckward counting. Even 

after cueing by (E) there were many blank expressions. Some students 
whe indicated that they had never counted backwards understood the _ 
nature of the task through the cueing and would attempt the tae&. Some : 
would succeed— usually .much more slowly than with forward rhrJna. For 
some the count backward would bemn but at sbms point a number word 
wouid Jirigger a switch to a forward chain, i.e., "ten, nine, eight, 
seven, eighc, nine.... 11 For some the backwar d counting chain was quite 
a complex cognitive process. The chain would begin "ten, nine, eiqht, 
(long pause) seven, sir, (long pause) five, (long pause) ^four, " ef c; 
The long pause miiiy involved starting at "or3" and counting up to the 
point where the block in the backward sequence occurred* (this could be 
vocal or s^t vocal counting) then continuing the backward chain. For 
some few these "pause processes/ 1 occurred for every number name in the 
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backward cii* ■ ^ ^owat^f. As suggested* this was quite a complex 
cognitive fo » For sfudcmts proficient in the task the backward _chaih_ 
of isstst: serrri-ai vb be no 3ibr^ com>*nding than the forward chain. Generally, 
bur observation 6 vs bt»Qn zivih significant hungers of catering first- 
grade children I -ve X^ited, or nc > expedience and proficiency in 
counting backward 

. Proceeding to rational counting tasks, the firs t involved placing a 
pile of blocks vsfore the child and asking him to show four, eight, ten, 
and thirteen. Ihe cumreration process ir^o^ed in such a task- ha j been 

examined by various investigators ~. Beckwith and Res tie (1955) describe 

the act of simple emigration to inciude (1) the sequenced chant of . 
numbe* names, (2) an associated indicator response (such as pointing) 
which is synchronized with each number name, (3) a discrimination 
between the set already counted and the set as yet uncounted, and (4) 
the termination of the process must be recbgnized~usually by the 
emptiness of the uncounted set. - In regard to this last point, enu- 
merating a subset of five (for example) from a larger set appears to be 
more difficult th x the exha©t±ve enomeratiou of a set of ftve* Wang, 
Restiick, and Booze* (1971) hypo thestzed that the addition of a "memory 
component" is very : /teeiy the factor that in- reased the difficulty of 
such a task. Their data suggested that ch* Jireh continued to count but 
objects beyond the number specified in the instruction. The tasks in 
the present interview involved the more difficult enumeration of a 
sonified subset from a larger set. 

As might be expected, it was observed that demons trating the two 
larger numbers, ten and thirteen, was more difficult than demonstrating 
four or eight. The "memory component 11 seemed to contribute to the 
observed difficulties, especially with the larger numbers. The studies" 
didn't necessarily go beyond the number requested (although some #?Jd-J» 
but would often have to step the enumeration process to ask (E) whi \. 
number had been requested. With some this might occur more than one 
during the processing of one of the large! _ numbers . Some students would 
pull blocks from tfcfc pile, organize them (linear rows or arrays), and 
then ehiimerate~putting extras back or pulling jiore from the pile as 

heeded. Some would pull blocks from the pile with a finger in sytu 1 - 

ch ronization with the oral count (voVd or sabvocai)_'with considerable ♦ 
physical separation between the counted^subset i^and uncounted set; others 
hardly separated the counted blocks from the uncounted set making only a 
slight physical contact. In the former case it was relatively simple to 
run a check on the accuracy of the count if the students wished (and many did 

want to check their count) , in the latter case such checks were not 
possible. 

Another interesting observation that could be made involved the way ^ 
students related the sequencial tasks. After desonstratiiss a set of 

fcur the next instruction was to show eight blocks. Some would quickly . 

relate that request to the previous task and buiid-on from four. Others 
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dii ^liis, but would go back to count the four first, as if to see if it 
was scill four; after the four more were in place some would then go 
back again and count the entire eighty There seemed to be some distrust 
of the stability of the number property of the set so that, for^safety f s 
sake, they went back and ghecked quite often. Of course^ with some* 
t>i±9 again may have involved a "memory component. " ISiesjmchrraizatioh 
of the number words with the motor indicator response of touching or 
moving the blocks was another source of errorih responses. Again, this 
generally showed up at the higher number levels. Some of the synchroni- 
zation problems were gross and were obvious even while enumerating small 
numbers of blocks; a few were very fine with the timing just slightly 

pff so thkt the cumulative dissonance between count and indicator 

movement would not throw the count off until it reached eight or nine. 



The^next two rational counting tasks involved the use of dot cards 

in discriminating and recognizing number properties. In each case, 

circular blue stickers were fixed to white 3x5 cards to become the 
stimulus pbjc.cts. Because it appeared that tasks dealing with small 
numbers ox dcts on cards posed different cognitive processing demands 
_than__cards xfith larger numbers of dots, a short digression £~o e x a min e 
that line of research is in order. ; 

Psychologists have been intrigued for years with the question 

dealing with span of apprehension. As early as 1871^ Jevons (1871) 

found that his estimations (of beans cast into a box) were invariably 
correct when the number of beans was ie?s than 5; as the number of beans 
increased the percentage of bbrrect_ estimations _de_creased--ahd in 
fairly regular fashion. Wairen (1899) concluded that* except under 
special stress of attention, or with subjects especially apt in this 
direction^ the function i of perception counting (number displays that 
appear to be apprehended as a whole$ without enu^ration) is lifted to 
the numbers one, two* and dicee. To apprehend numbers greater than 4/ 
then, some other perceptual function w'^st come into play ^ fav,*s (19415 
concluded from his data that "here are two mechanisms for the" perception 
of visual numerousness . One operates ^hen the number of dbta in the 
stimulus field 2 a xtrail ^number;-? up fb 5)^ the second mechanism operates 
when the number of dots is so gCMi- as to prohibit direct, and rapid 
recognition of number (greate:* tlt&h 6) . (Wv ^u^mah et. al. (1959) supported 
the two different 'ne<*ahism_hyp6^he3es anc that the change occurred \ 

about at_ 6 stimulus dots. Their data did not support Saltman and 

Garner (1948), and other earlier e^pevi^enters,^ that suggested there was 
ah immediate cognition of number with presentations of 1 to 6 stimulus 
dots. They found the time between stimulation and report increased 
regularly with dot presentations from . to 6, therefore bringing into 
some question the "Sraitediate cbgnitit^ lv hypotheses. A considerable 
number of independent variables have :,een examine! as to their influences 
on the. apprehension question. Some of these variables include: density 
of objects ±5 the. display* organization of the objects, meatiingrtaness 
of the objects* area of the field of apprehension, rapiolt-/ cf pre- 
sentation, mental set of resporder, and many others. 



— - - — + - .__ # _ 

This short digression examined a few aspects of a stream of inquiry 
regarding apprehension of the number property of a set. It seemed 
appropriate in light of the nature of the rational counting tasks used 
in the^ first-grade interviews , and in light of some of the children 1 s 
performance on the] tasks. Examination of the tasks and observation oi 
children's performance on the tasks now cont+c^s. 

The next rational counting task-inv^^ presenting a child with a 
set of three dot cards; one with 2 dots, oyu<. ^Xth 3 dots, and one with 4 
dots. They were ins true red to indicate tae card with three dots, the 
same procedure was used with six dots (with a 5-dot and 7- dot card in 
the display), t™. 4ots (with a 9-dot and 11-dbt card in the display)* 
and thirteen ; r> f±th a 12-dbt and 14-dbt card in the display). 

As you wi : : i u ,:?> -P ec ?^??? e _ e ??9? s occurred in _choos±ng the greater 

number cards t:-"v^ e lesser number card$. Generally observations by 
(E) suggested ti»*fee broad categories of techniques used by children in 
responding to the tasks. There were the serious counters, the more 
impulsive global choosers * and those that seemed to choose the means to 
fit the task and combined the use of both methods. Generally these 
observations confirmed^ the various categories of counting techniques 
reported by Denmark (1975). 

The serf dus counters counted every card, even those with two, 
threat, and four dots. Even _if the requested card were the first counted, 
they would count the other two cards in the trio presented. As observed 
by Denmark (1975) , there were both visual counters (no pointing to 
and/ or touching each dot) and counting that incorporated overt motor 
responses of the fingers pointing to and/or touching each dot. The 
"memory component" appeared to enter into the task. Although the 
enumeration of a given card was an exhaustive one, and therefore, they 
did not have to recall where to stop counting, they would of tin have to 
be reminded of the number they were looking for. Errors of the serious 
counters generally occurred with the greater numbers and of ten involved 
the component of counting examined by Potter and tevy (.1^68) r the 
ability to point to (or look at) each item in the array, one at a time y 
until all had been taken exactly once. Errors would occur when r-dot 
was skipped (omission) in the process, or would be counted more than 
once (redundancy). As with both Potter and Levy (1968) and Denmark (1975) 
there appeared to be student*? who systematically ordered the spacial 
ffeld in enumerating it, while others would use (what appeared as) a 
rather random enumeration of the field.- Insufficient evidence was 

?Y?^^?^^ e _°? _^^?^_P5r ic ?? s ^?8_???5^? re ( ^f eithe r) w as more closely 
associated with errors in enumeration. Some (E) commented, however, on 
the rather incredible ability of certain "random enumerators" to be 
accurate in their counts and continuously avoid omissions and redundancy. 

The fibre impulsive choosers would generally react very quickly to a 
direction and choose a dot card. There was little evidence of counting. 
Ihe observation was that this procedure would often work quite well for 
tie 3-dbt and 6-^bt tasks but Ted to errors on the lCFtfot and 13-dbt 
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tasks. the digression a few paragraphs back to studies that examined 
apprehending ability may be apropos to these observations. Recall the 
hypotheses regarding two different mechanisms for judging numbers, one 
for numbers of objects of about six or less, and a different process for 
numbers greater than six. It appeared that tr?. &\ic<&\>i Gome students 
had in quickly identifying the 3-dot and 6-ddt ur-?-& (*ad the positive 
reinforcement for that success from E) created a mental set that compelled , 
some to continue responding impulsively. They seemed unaware that a 
shift in processing procedure way bfc necessary as the numbers got 
greater. For the majority of atudeocs the task with 10-dots and 13- dots 
poses a "problem" since it is generally beyond their ability to give a 
quick and accurate habituated response. Luria (Callahan, 19755 has 
suggested that an important phase of problem solving involves the 
restraining of Impulsive responses and the investigation of the con- 
ditions of the problem. This was quite obviously absent from the 
impulsive chooser's reaction to the tasks witft larger numbers. 

On the other hand, there were some students who seemed to be aware 
that they could react, impulsively at rhe 3-dot and 6-dot levels^ but 
needed cc switch processing procedures with the id-dot and 13-dot tasks. 
Some few a cedents actually verbalized -this to (E) . After choosing the 
3-dot aid 6-dot cards quickly the* said, "Now I have to count." . They 
seemed to be able to restrain an impulsive response and be aware of the 
different conditions of the task. 

The next: rational counting task involved sorting 3-dot, 6-ddt, and 
lb-dot cards Into appropriate piles. Three criterion cards (one with 3- 
dots, one with 6-dots A one with 10-dots) were attached to a folder. A 
deck of 12 ca**s (f^^ with 3 dots^ four with 6 dots, four with 10 riots) 
was shuffled and the task demonstrated by (E) . The child was then 
hauded tFa remaining cards to place in . prbnriat > piles t _ The arrange- 
ment of the dots on each 6-dot card* for example, was different. There 
were no cards I the deck that did hot belong; it was an exhaustive 
classification of the three numbers. :: — 

Generally this task was somewhet easier than the previous task* 
Again there were the ser+cus couriers, the impulsive sorters, and those: 
who would use both procedures depending on the number of dots involved ; — 
The "memory ccmponent" was ogain operational with some of the counters • 
They would count the top card its the/ deck (example six); by tt*ei; they 
would have forgotten the timber of dots on the three criterion cards and 
would have 16 count those *-gain before the choice couXu oi> <ia<.le« _ In 
some severe >tses 'tl\lr* pitig-pbngiag of f or getting the nuribe.c _*>t dots oh 
the sorv card and the criterion evrde jxippened continuously dt r.lag the 
?-ask. It would appeal that the impulsive sorters fared better on this 
task. The discrimination was -much grosser and the sorting of 3-6-10 dor, 
cards was probably much lest* _a •'problem" task. The impulsive sorters 
did have sone problems wheo t&*y w^re fectd wxuh similar Jforms of arra^emtr.-tts 
??J*°_ ts ? n _? card fchough the ns aasrs- were different. For example, if - 
the two c ards b elow would appear consecutively in th^ deck to be sorted 
it wbul^. I I f I often lead to error by the impulsive sorters, 
since j * * *{ they would place them in the same pile. Such 
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similar forms seemed to have less effect on the counters. Some of the 
students would impulsively sort the. 3-dot cards and 6- dot cards and then 
count (at least one or two) of the ten-dot cards. j 

The final tasks involved ordering a set of seven dot cards (one 
through seven dots inclusive) from least to greatest; and a set of seven 
numeral cards (one through seven inclusive) from least to greatest. A 
general observation was that when there was familiarity with the ntim- 
. erals, that was ara_e^iex trak than order ing~l:he dot cards*.. In ordering 
the dot cards all the behaviors discussed in the previous tasks mani- 
fested themselves. Some counted. Some d,id not. Some would impulsively 
order through. about five and then would have to count to determine which 
of the two remaining was the six-card and seven-card* In/ ordering the 
numeral cards it was not unusual to have the numerals backward or upside 
down in the sequence, but still have them ordered, correctly* Again, the 
"memory component" would of ten come into play in both tasks. While 
examining the next card to be ixde red, some would forget how far they 
had already ordered the cards and would go back to the beginning to 
couac up to where they were in the sequence. 



These then were the ta**J<3 on the first grade interviews that 
involved counting. 



An opportunity arose relate the counting performance of the 
approximately forty firs t~ ? aders descrtbe^in the previbus^paragi 
with their performance on an arithmetic achievement test. Subsets of ! 
tasks on tht standard achievement test were examined. "On the "Concepts 4 ' 
part of the test, two s~-3ets^were examined tasks _which did not _?equire; 
"F^^S.i^B^le:^ "Mark cnder the roac ^hat'is the widest") and taskei 
which probably involved counting ^Maifk under fee group that has the 
most pieces of candy.") On the ''Problem Solving" part of the test^ 
those items where addition was required. ("Paul has three cents* His 
mother gives him three more. How many cents does he have then?") were 
clustered and those requiring subtraction ("Barbara had 0 six jacks. She 
lost two of them. How many, does she have now?") were clustered. 
Likewise , on the "Confutation" section the addition - (2 _+ 6 - . t _) task 

and subtraction (4 - 3 » ) w ??f_^?®^?5?^_separateiy A Thtze aspects \ 

of the counting taste in the interview j^ere examined; rote counting 
forward, rote counting backward ^ and rational counting. 

A given student's performance on two task* (one counting, the other 
a test task) was entered in a table. Illustration 1 indicates an entry, 
S s for a student who rote counted to 19 'and; performed at a difficulty 
level of 0.43 (number of items correct/total number of items X on the 
"concept" 4 terns requiring no counting* 
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A median-split was then used to "collapse" the data in a*2_x 2 - . 
table. Frequency of students above the median (A) on one set of counting 
tasks and above the median (A) on a set of test tasks; above the median 
(A) bh one set of counting tasks and below the median (B) oh a set of 



; est tasku; below the median (B) on one set of counting tasks and above 
the median (A) on a set of test tasks; and below th£ median (B) on one 
set of counting tasks and below the median (B) on a set of test tasks, 
are 3hown collectively in Table ii " % 
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The frequencies -within a median row or column of the grouped data are hot 
reflected in the 2 x 2 tables, therefore the fluctuations in _ the total 
number of students reflected in the tables. They relate and°reflect/ the 
more extreme performances ox the test tasks and counting tasks* A great 
deal of catitibn must to tafcf?-^ in drawing relationship conclusions from • 
such an unsophiar* raied 9\\^l^H±6. It was done tp-fisnply get a gross— 
feeling for sour* * *ibL crises and cues for more penetrating analysis 
of data gathers ;he future* - 

Some observations or| rote counting forward and test tasks: 

- a positive correlation could probably, be ; expected between 
rote errant ing performance and performance bh achievement 
test tasks. 



- the deviant i BA-AB, cells suggest that there may generally 
be more students below the. median on rote counting performanc 
but above tke median on test tasks than vice versa. 

- rote counting ability nsy be geners:! " y related to achievement 
test item performance rather than specifically and differen- 
tially related to various 3ubsets of items. I 

f .- 

Some observations on backward, counting and test tauiv 

- a ppSitive~c|drrelatibn could probably be expected between 
backward counting performance on achievement rest tasks • i 
This correlation might be greater in degree* than the 



correlation 
achievement 



backward c 
ment test 
dirferen 



item, 
tialjly 



Some observations on— rational ci 

- a positive ctsxrrelation c>> ; 
rational ccinting perform*. -j& 
tast tasks, j 



°^_l°™? r § counting and rational counting with 
test tasks. 



ability may be generally related to achieve 
performance rather than specifically and 
related to va>:.:n«,s subsets of items. / 



... ! 

lity and test- tasks: 
.>"y be expected; between! 
, .rformanee on achievement 

1 . I: 



- the deviant BA-AB, v cells suggest that thft^e may ' ^.nerally 
be more s tudent s above the med ian j on rat ionai_ cop tng 
performance [and below the median on achievement te:*c 
performance ; rhan vice versa. 
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- rational counting ability may be generally related to 
achievement tes t_ item performance rather than apecif icaiiy 
and differentially related to various subsets of items. 

__ - '. " ... 

It would appear that per formance^n the various counting tas/.s 
contained within the first grade interview ^are positively correlated 
with performance on a standardized achievement test* Altltough the PHDC 
Mathematics Test-Grsd.e One cbntates many items other than those associated 
with counting performance, tfiey re^pbrjt correlatibns of a. 79 between the 
PMDe and the Key Math measure*, and 0u72 between PMDC at id the Ot is-Lenaon 
(1975). The initial crude a? flu > sis carried but here would_ suggest a 
rather high degree of correlation may 1 exist bea m the i ability to 
perform the various counting tasks aru^ performance on a standardized 
achievement teat. The relationship would appear to be general rather 
than specif ii to certain subsets of achievement test ta^ks. 



The studeibts in the small group reported on in this paper were 
first grader fifj&n two different classrooms two years ago. They are 
presently th&^graders* i recently attempted to follow-up on how 
they are' performing in school arithmetic. Of the approximately 40 
students, there are twenty-one still in the school at the third grade 
level* Some have been held back a grade, others have evidently proved 
out of the school. Of the twenty-bhe, twelve performed at or below the 
fourth stanine bh a standardized test Jit the end of the second grade. 
Another administration of a standardized test x at the beginning yof 
third grade confirmed this rather low performance on standardized 
tests of arithmstic^ The nine others in the thiru grade-were functioning 
above th£ 4th stanine on a standardized tf»st at the end of second grade. 
Table 2 presents a comparison of performances of the underachievers 
(iovrer 4 stanine) with the achievers (above tlie 4th stanine) . 
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Although auch caufiion mist be used in making inferences from such a 
small ind nbn-ranabm group of children, there is at least a suggestion 
that the counting taski^Save some jdegree of predictive validity in 
regard to arithmetic achievement. 

This paper started by presenting some authoritative comments on 
the impbr tance-/b^^nmang_as a basic skill of arithmetic. Evidence 
from some "pilot" administrations j of counting tasks to' first graders 
suggested a relationship between counting tasks and standard achievement 
test performance. . Finally, Sbr a small number of students iiivblv^ J 
with the pilot administratiph^ it would appear as if Skill in counting 
on entering first gride_may have some predictive value fdr success in 
school arithmetic . ' These Observations must be very^ tentative because 
of small numbers ana lack of rigor in design atid analysis. 
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Observlng young children Involved with performing simple counting 
tasks makes one aware of the complexity of these deceptively simple tasks. 
In microchosmV"they make demands on many of the complex cognitive 
processes needed for success in school arithmetic. Counting tasks, 
although reacted to differently by different students, seem to 
incorporate in some ways the entire range of synthetic mental activities 
m ? Il ?^ one ^_^y_5 ar ^? 73) [:_ perception; movement and action, attention, 
memory, speech, and thinking. 

In speculating on some implications regarding counting in the 
school program, it may be useful to take. a further look at some of the 
work of Luria in the area of neuropsychology . He presents three basic 
laws governing* the work structure of the individual cortical regions 
of the brain. The first is the law of the hierarchical structure of 
the cortical zones: the primary zone, the secondary zone,' and the 
tertiary zone. ^is ?ystem^oes not remain the same but changes in 
the course of onto zeue tic development. The second is the law of 
diminishing specificity of the hierarchically arranged cortical zones: 
the primary zones possess maximal modal specificity, in the secondary 
the specificity is present to a lesser degree, in the. tertiary zones 
there is even less specificity. The secondary and tertiary cortical 
zones have a predominance of multi-modal and associative neurons. 
There appears to be progressive transfer from the primary regions 
to the secondary and tertiary where specialization of function 
seems to occur. 



By the time students enter sch oo l, development from^the primary 
regions to the secondary and tertiary should be well underway- 
Continued appropriate development; then, would seem to be best 
nurtured by an environment rich with opportunities to relate, to 
associate, to develop voluntary attention within complex settings, 
and to develop the higher cognitive functions. 

A simplistic reaction to the role of counting in achievement 
may be to directly and s Imp lis tically work on counting, backward, 

forward, and rational, outside of a meaningful setting. TW-?_ w °ul<i_ 

probabi^ do more harm than good. In light of the developmental needs 
of the child, counting experiences should grow from a socially 
stimulating setting where a sensitive teacher subtly involves the 
child in Activities where counting takes place within a meaningful 
setting ... then the dynamic relationships which mark cognitive 
development will be best served. 

One of our jobs is to continue to search for the right questions 
to ask our students, to observe behavior, to reflect on the meaning 
of that behavior within the^broader contexts of intellectual growth 
and development, and to firm-up the inference lines between learning 
and development. Then perhaps we can offer teachers the kind of 
professional preparation suggested by Mayer (1961) and cited by Lovell , 
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What_ future teachers heed, arid cannot find, is the course 

which attempts to explore the profound aspects of the deceptively 
simple material they are going to teach, which analyzes case 
by case the types of difficulty that children find in approaching 
such material. 
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TEST CONCEPTS TASKS (Counting) 




Illustration !• Median Split Procedure 
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Table 1 

Frequency above (A) at|d below (B) 
Median on Counting and Test tasks 
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Table 2 

Comparison of Counting Skills at first-grade Entrance 
for two Groups of Third Graders 
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Reaction Paper 
to 

Counting Performance and Achievement: 
Some Preliminary Observations 



James W. Heddetis 
Kent State University 



The three quotations that Dr. Caiiahan^has cited in his paper seem 
to place counting in three different perspectives. Buchanan, in his 
statement, places counting as the primary ba&e upon which a mathematics 
program is developed. Catherine Stern} in her book Help Children Dis- 
cover Arithmetic , seems to place, emphasis upon relationship first, 
followed by the development of number, then the development of numeral. 
Piaget f s work seems to place counting in a different perspective. 

Hilton's quotation places his emphasis upon competence in the 
nse of the number system; One does jot know if counting, comparing, 
ordering^ and measuring are placed in a significant order. Pi age t 
wbuld consider comparing prior to counting. He would follpw comparing * 
with rote counting, then rational counting, ^f a child has considered 
comparing, thehmoves to counting, is he using rote counting or ra- 
tional counting? 

Rubens tein commences his statement with the word "understanding 11 
and as soon as this is ind ica t ed then we are cons id er ing r a t ional 

counting and not rote counting. Se has sequenced counting firs t^^ 

followed by comparing, then ordering. Again, this seems to disagree 
with Piaget f s work. 

Callahan has used excellent procedure in defining the difference 
between rote and rational counting. He has done this by suggesting 
different types of tasks for each type of counting. The definitions 
would be more meaningful for me if some type of evidence could be 
presented that would verify that the tasks really do indicate either 

rote or rational counting^ ^ n _?y_9Pi5io n the task of asking _a child 

to count forward and the task of asking a child to count backwards 
are two different levels of functioning. I have difficulty placing 
both of these tasks under the heading of rote counting. 

Gagne's theory of verbal chaining seems to be ah excellent tech- 
nique for evaluating the level of functioning in rote counting: Then 
we must assume that the longer the verbal chain, the higher the level 
upon which the child is functioning. 

Callahan's observation that if a student could count to sixty 
then he could make it tr one hundred seems to indicate more than rote 
counting. Evidently, the student was able to generalize a pattern 
and apply that generalization in order to count to one hundred. Has 

-93- 

<M 102 



the child moved from rote counting to rational counting?. Then the 
question needs to be considered at what point in the child's develop- 
ment are we willing to say a Child changes from rote counting to 
rational' counting? 

The linguistic explanation suggested by Callahan seems appropriate. 
The linguistic work of Hargis seems to support Callahan/ s analysis, i 
feel that more research from the mathematical and iinguisticai ap- 
proaches heeds to be considered. 

Callahan's observation that counting to 196 was more enjoyable for 
young children seems to me to be a logical conclusion. Parents stem, to 

prize courtting and often ask children The younger the child , 

the more positive reward is obtained by counting further. Positive 
strokes will encourage the child to concentrate on counting farther. 
At what point will the child discover a numeration pattern and switch 
from rote counting to rational counting? Maybe parents receive more 
self gratification from their _ child 1 s counting than the child himself 
receives . Thus the parent will place more pressure upon the child to 
count further. Consequently, we have developed a cyclic effect. 

Grossnickie^nd Brueckner in their 1959 edition of Discovering 
Meanings in Arithmetic have done an excellent job in describing the 
nature o£ counting. They define six different stages in the complete 
process of counting.; The six stages are (1) rote counting, (2) enumera- 
tion, (35 Identification, (4) reproduction, (5) comparison, and (6) 
grouping. - 

Rote counting is defined as a mere repetition of numbers in 

sequential order without meaning. Grossnickle and Brueckner do not 

indicate how an individual evaluates a child's counting to fcnqwif 
<,the saying of the number name in sequence has meaning for a child* 

< _____ 

En um eration is defined as_ rational counting and means to find the 
number. of objects in a set. Thus a child must be able to use one-to- 
bhe correspondence in counting the objects in, a set. It would sera to 
me that in observing children the way this child functions would indicate 
his level of understanding. As I have observed yotmg children * count- 
ing is a touching process with the utilizing of one-to-one correspondence 
Ask a five year old child to count the number of children in a room and 
he will proceed around the room and touch each person as he says a 
number. A next higher level seems to* be apparent as the child stands 
and points; to each individual as he counts using bne-tb-bne correspon- 
dence. Now he is still using bne-tb^bne correspondence but he has 
placed a distance between *the objects being counted and the finger. 
The next higher level seems to be when a person nods his head and 
counts using bne-tb-bne correspondence^ I have observed children who 
use touching their own nose with fingers as they count or clicking 

their teeth as they count. A more sophisticated level of counting is 

when a person counts by directing his eye to each member as he counts.. 
This is probably a method that is still being used by adults as they 
count . 
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Identification is defined as answering such questions as which set; 
has four spoons. A child could answer the. question either by counting 
or by mere recognition. Maybe we encourage children to use immature 
methods when we auk a child to count: the number of spoons in the set. 
How do we know if the child could have recognized the fourness without 
counting? In my opinion we encourage children to depend upon counting 
to provide responses, rather than encouraging them to learn recognition. 
In our work we use flash cards with dots on them and flash them rapidly 
and ask the children how many. Most five year old children* can handle 
up to five dots "without counting.* 

Reproduction is defined as giving the correct response to such 
questions _as "Sive, me _fqur_ ^ by 
selecting four spoons from a larger set of spoons. I would also 
observe °how the child behaved. Did he count but four spoons, or did ^ 
he count by twos to get four spoons, or did he merely recognize four 
spoons and pick them up? Again I see subdivision to the categories, 
the classification suggested by Grossnickle and Brueckner. 

questions as "Hqw many more silver spoons are there: than plastic spoons?" 
In answer to that question, it sterns to me there are three different ways 
in which the child can function. 

Grouping is shown when the child identifies at a glance the number 
of objects in a subset without counting and then counts from that point 

on. The child again has several options as to how he can function • 

j * 

_ _T^?_? e ?§ a ??^ from the early forties done by Carper needs to be 
?fPy????^_? s _¥?^_?^ ^^?_ w 9?^ 5?^ _P™ .Maybe _±5^wouId be to our 

advantage to reexamine the group test devisrd by J. Kern at University 

of Freiburg for testing maturity levels of counting. 

■ ji 

Callahan has gone on to utiiize more^asks and to disctlss child- 
ren's responses. I feel this is an excellent ^beginning. Yet many 
questions keep appearing that sHould be considered w * For instance, 
should more theoretical analysis of the content be attempted prior 
to collecting responses from children? After logically sequencing 
the theoretical levels of. counting can tasks be designed that can be 
validated to verify that each task is indeed functioning on the level 
specified? I feel the technique used by Nichols and Denmark to be 
excellent. After a protocol has been established, follow the protocol 
and videotape each case during response, thus the researcher does hot 
need to think about the protocol, observe the child's behavior, record 
the child's beh&vior and try to interpret the behavior all at one time. 
Now the researcher can concentrate on the protocol solely, for the 
videotape is recording the behavior. The researcher can interpret and 
analyze the tape at a future time when he can zero in on a specific 
aspect. The tape is also available for multiviewing, thus providing 
an opportunity for several different individuals to interpret the data 
and for several viewing s of the child's behavior; 



A PERSPECTIVE ON THE FUTURE 

* ] : 

J - James W. Reddens, President 

^Research Council for Diagnostic and Prescriptive Mathematics 

/ . . [__;<. l_ ^ 

One can observe young children having difficulty learning mathe- 
matics . We have reading^centers for children suffering with reading 
difficulties, we have spec?i£Lists to work with children suffering 
from seeing or hearing difficulties, we have hospitals devoted to 
helping ctflldren with physical difficulties, and many more special 
areas. Where do we have professional trained individuals working with 
children suffering from mathematics difficulties such as acalculia or 
dyscalculia? Why haven't the individuals responsible for mathematics 
developed and prepared instruments, materials and techniques for 
"remedial mathematics"? 

Over a period of years we have observed Gay Bond working in this 
area of reading at the University of Minnesota, we have observed _ 
Durrell at Boston College, Sheldon at Syracuse, and many others* When 
we study their work we find much repetition. Why didn't these individ- 
uals pool their talents and resources? Why does each individual have 
to reinvent the wheel? This has bothered me for years, consequently 
the questions are: 

1» Can the mathematics people cooperate in their research? 

2. Can diagnostic and prescriptive research in mathematics 
education be organized nationally or internationally? *• • 

3. Can duplication of work and effort be avoided? 

With these questions in siind and the - cooper at ion of KEDS General? 
Assistance Center, Kent State University organized the' First National 
Conference cn Remedial Mathematics in 1974 . As a result of this first 
conference, papers arid reaction papers have been prepared and these 

now are published rad available frOTptlC^ In my opinion these 

papers and reaction papers are a major contribution and seem to be 
setting a bench mark. 

In 1975 the Second National Conference on Remedial Mathematics 
was held at Rent State University. A different format was used. 
No papers were produced and consequently there is no published 
material. We made and used some video tapes, but I am not sure that 
the video tapes are of a quality that we would want to reproduce. 

In 1976 the Third National Conference on Remedial Mathematics 
was held. In co^fi^ttbn^tth the Third National-* Conference we con- 
centrated on researctiv &s a result of this conference it was 
decided to organize^^research council. Bill Speer presented to 
the group a very complete bibliography and compiled a dictionary 
of terms focusing omthe diagnostic-prescriptive arena* 
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A steering committee was appointed to lay the foundation for a 
new organization — The Research Council for Diagnostic and Prescriptive 
Mathematics. It was decided at this 1976 meeting to have membership 
open to all interested individuals—mathematics teachers, superiRLsors , 
coordinators, mathematics professors, mathematics education profes- 
sors, *and researchers. * 

Where are we today? Where are we headed? We now are a group 
with a Constitution and By-laws, elected officers, and a solid 
membership. ; 

I would like to blue sky with you for a few minutes and project 
as to what I see as our future. - I am not v interested in sheer numbers 
of members. I am interested in sincere, dedicated, humane individuals 
who are willing to cooperate, to develop new and exciting research, 
and to help people learn mathematics '' ; 



In my opinion the most important position that has been estab- 
lished by our new Constitution is the Vice-President for Research. 
This position carries with it the task of helping ..all of us cooperar- 
tively organize research in mathematics education throughout the 
United States and Canaaa so that t united^ front will develop from 
within mathematics education. Can we eliminate duplication?; Can we 
get teams of researchers (such as classrooA teachers, supervisors, 
coordinators, administrators, and professors) working together in 
research projects to solve our problems, to synthesize innovative 
approaches, to create insightful diagnostic instruments and diagnostic 
techniques, and to develop, new and interesting material? Can the 
Vice-President for Research organize this united front through the 
Research Council for Diagnostic and Prescriptive Mathematics? Can 
a consortium be created with each unit researching a portion of a 
much larger problem so that all the pieces fit together into dne^ large 
puzzle? Can we furnish different samples from various parts of the 
country?. At the Maryland conference we had participants from thirty 
five different states, nine Canadian provinces and West Germany. 
What would result if some were: willing to locate samples of students 
to participate in a large research project?. If each was willing to 
use a designated protocol with a sample of children? If each was 
willing to help collect research data? 

I f eel we" have the dynamic embryo, for the most extensive 
research project ever undertaken axyl the potential can be found 
in our members. You are the person-power that is needed. If we 
are organized, if we can define the needed research, then why can't 
we deA^r lop proposals for federal or private^foundation funding?' 

Y^? u ?i^? _^ / ^ a ?_??_^?F act vve can aavc on mathematics diagnostic and 
prescriptive teaching. 

I have shared with you some of my ideas and feelings about bur 
future. Can we accomplish such a mammoth undertaking? Anything is 
possible with a positive attitude, a united front, and hard work. 
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Do yoa want to be a part of this dynamic organization? We would 
enjoy having each of you working as part of a team. 

A united front heeds to be developed to organize and to avoid 
duplication of research in this area. Diagnostic instruments need 
to be developed , techniques of diagnosing need to be developed, and 
unique methods of corrective teaching need to be developed. Re- 
searchers will be needed at all levels— in- the clitiir *Tid in the 
classroom^ professors, clinicians, supervisors, and classroom teachers, 
There is room for everyone to actively participate in the Research 
Council for Diagnostic and Prescriptive Mathematics. 
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